Jul 14 14:28:50.793931 ip-10-0-135-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 14:28:50.793943 ip-10-0-135-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 14:28:50.793950 ip-10-0-135-215 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 14:28:50.794240 ip-10-0-135-215 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 14:29:00.872091 ip-10-0-135-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 14:29:00.872112 ip-10-0-135-215 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6fc079759d6944f3a8da53a3de4d03cf -- Jul 14 14:31:03.329946 ip-10-0-135-215 systemd[1]: Starting Kubernetes Kubelet... Jul 14 14:31:03.698083 ip-10-0-135-215 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:31:03.698083 ip-10-0-135-215 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 14:31:03.698083 ip-10-0-135-215 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:31:03.698083 ip-10-0-135-215 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 14:31:03.698083 ip-10-0-135-215 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 14:31:03.700667 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.700593 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 14:31:03.704734 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704720 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.704734 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704734 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704738 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704741 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704744 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704746 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704749 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704752 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704754 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704757 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704760 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704764 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704767 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704770 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704773 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704776 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704779 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704781 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704784 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704787 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704789 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.704796 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704792 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704794 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704797 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704799 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704802 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704805 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704808 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704810 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704813 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704815 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704817 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704820 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704822 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704824 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704827 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704829 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704832 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704835 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704837 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704840 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.705253 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704843 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704845 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704847 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704850 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704852 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704855 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704857 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704859 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704861 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704864 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704866 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704868 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704871 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704873 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704876 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704879 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704881 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704883 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704886 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704888 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.705773 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704890 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704893 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704895 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704898 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704900 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704904 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704906 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704908 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704911 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704913 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704916 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704920 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704923 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704926 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704928 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704931 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704933 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704936 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704938 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.706244 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704940 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704943 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704946 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704948 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704950 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704953 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704955 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704959 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704961 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704964 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704966 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704968 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704971 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704973 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704977 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704979 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704982 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704984 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.704987 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.706709 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705623 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705638 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705642 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705645 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705647 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705651 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705653 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705655 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705658 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705660 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705663 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705665 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705668 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705670 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705673 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705692 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705696 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705700 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705704 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705706 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.707193 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705710 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705714 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705717 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705720 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705723 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705725 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705728 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705730 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705732 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705735 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705737 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705740 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705742 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705745 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705747 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705749 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705752 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705754 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705757 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.707717 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705760 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705762 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705766 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705769 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705771 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705774 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705777 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705780 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705782 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705785 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705787 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705790 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705792 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705796 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705798 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705801 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705803 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705805 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705808 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705810 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.708164 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705813 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705815 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705817 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705820 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705822 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705825 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705827 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705829 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705832 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705834 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705836 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705838 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705841 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705846 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705849 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705852 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705855 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705857 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705860 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.708638 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705863 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705866 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705869 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705871 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705873 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705876 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705880 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705882 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705884 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705887 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705889 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705892 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705894 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705896 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705899 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705901 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705904 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705907 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705909 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705911 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.709109 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.705914 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706290 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706296 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706299 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706302 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706304 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706307 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706309 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706312 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706314 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706317 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706319 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706322 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706324 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706326 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706329 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706331 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706334 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706338 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706342 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.709583 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706344 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706348 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706351 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706353 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706356 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706359 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706362 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706364 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706367 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706370 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706372 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706375 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706378 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706380 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706383 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706385 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706387 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706390 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706392 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706396 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.710073 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706400 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706402 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706404 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706407 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706409 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706411 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706414 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706416 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706418 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706421 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706424 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706427 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706429 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706432 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706434 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706436 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706439 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706441 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706444 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706446 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.710553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706448 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706451 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706453 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706455 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706458 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706460 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706462 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706465 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706467 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706470 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706472 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706475 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706477 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706480 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706482 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706485 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706487 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706489 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706491 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706494 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.711045 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706497 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706499 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706502 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706504 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706507 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706509 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706511 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706514 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706516 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706519 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706521 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706523 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706527 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706530 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706533 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706535 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706538 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706540 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706543 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.711517 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.706546 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706606 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706613 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706618 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706623 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706629 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706633 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706636 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706640 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706643 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706645 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706648 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706651 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706654 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706657 2562 flags.go:64] FLAG: --cgroup-root="" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706660 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706663 2562 flags.go:64] FLAG: --client-ca-file="" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706665 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706668 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706671 2562 flags.go:64] FLAG: --cluster-domain="" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706674 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706691 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706695 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706698 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 14:31:03.711994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706701 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706704 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706707 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706710 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706713 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706716 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706719 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706722 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706724 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706728 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706731 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706733 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706736 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706740 2562 flags.go:64] FLAG: --enable-server="true" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706743 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706747 2562 flags.go:64] FLAG: --event-burst="100" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706749 2562 flags.go:64] FLAG: --event-qps="50" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706752 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706755 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706757 2562 flags.go:64] FLAG: --eviction-hard="" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706760 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706763 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706766 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706769 2562 flags.go:64] FLAG: --eviction-soft="" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706772 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 14:31:03.712543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706774 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706777 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706780 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706782 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706785 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706787 2562 flags.go:64] FLAG: --feature-gates="" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706790 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706793 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706796 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706799 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706802 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706804 2562 flags.go:64] FLAG: --help="false" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706807 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-215.ec2.internal" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706810 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706812 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706815 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706818 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706821 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706824 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706826 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706829 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706832 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706836 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706839 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 14:31:03.713186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706842 2562 flags.go:64] FLAG: --kube-reserved="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706845 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706847 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706850 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706853 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706857 2562 flags.go:64] FLAG: --lock-file="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706860 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706863 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706866 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706870 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706873 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706876 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706879 2562 flags.go:64] FLAG: --logging-format="text" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706881 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706884 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706887 2562 flags.go:64] FLAG: --manifest-url="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706890 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706894 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706897 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706900 2562 flags.go:64] FLAG: --max-pods="110" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706903 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706906 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706908 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706911 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706914 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 14:31:03.713821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706917 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706919 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706925 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706928 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706931 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706934 2562 flags.go:64] FLAG: --pod-cidr="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706937 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706942 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706945 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706948 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706950 2562 flags.go:64] FLAG: --port="10250" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706953 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706957 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f66d6cd723b88d37" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706960 2562 flags.go:64] FLAG: --qos-reserved="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706963 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706966 2562 flags.go:64] FLAG: --register-node="true" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706968 2562 flags.go:64] FLAG: --register-with-taints="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706971 2562 flags.go:64] FLAG: --registry-burst="10" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706974 2562 flags.go:64] FLAG: --registry-qps="5" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706976 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706979 2562 flags.go:64] FLAG: --reserved-memory="" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706982 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706986 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706988 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706991 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 14:31:03.714416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706993 2562 flags.go:64] FLAG: --runonce="false" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706996 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.706999 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707002 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707005 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707007 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707010 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707013 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707015 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707018 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707020 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707023 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707026 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707029 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707032 2562 flags.go:64] FLAG: --system-cgroups="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707034 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707039 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707041 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707044 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707049 2562 flags.go:64] FLAG: --tls-min-version="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707052 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707054 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707057 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707059 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707062 2562 flags.go:64] FLAG: --v="2" Jul 14 14:31:03.715028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707065 2562 flags.go:64] FLAG: --version="false" Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707069 2562 flags.go:64] FLAG: --vmodule="" Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707078 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.707081 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707181 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707185 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707187 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707190 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707193 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707196 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707199 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707202 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707204 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707207 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707209 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707212 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707214 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707217 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707220 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707223 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.715674 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707227 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707230 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707233 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707236 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707238 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707241 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707244 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707246 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707249 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707251 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707254 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707256 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707259 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707261 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707264 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707266 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707269 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707271 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707273 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707276 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.716163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707278 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707280 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707282 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707285 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707287 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707290 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707292 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707295 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707297 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707299 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707304 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707306 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707309 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707311 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707314 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707316 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707319 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707321 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707324 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707327 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.716659 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707329 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707332 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707334 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707336 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707339 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707341 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707343 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707346 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707348 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707350 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707352 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707356 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707360 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707362 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707365 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707368 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707370 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707373 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707375 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.717152 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707377 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707380 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707382 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707386 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707388 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707390 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707392 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707395 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707397 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707400 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707403 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707407 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707409 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707411 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707414 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707416 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707420 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707423 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707426 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.717606 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707431 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707433 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707435 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.707438 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.708230 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.714765 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.714781 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.714799 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.714808 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714868 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714873 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714876 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714879 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714882 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.718133 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714885 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714889 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714892 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714894 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714897 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714900 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714902 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714906 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714908 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714911 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714914 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714919 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714923 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714927 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714931 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714934 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714937 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714939 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714942 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714944 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.718502 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714947 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714949 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714952 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714954 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714957 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714960 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714962 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714965 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714967 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714969 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714972 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714974 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714976 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714978 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714980 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714983 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714985 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714987 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714990 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714992 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.718999 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.714997 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715001 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715005 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715009 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715013 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715016 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715018 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715020 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715023 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715025 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715027 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715030 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715032 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715034 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715037 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715039 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715042 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715045 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715047 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.719651 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715049 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715052 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715054 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715056 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715059 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715061 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715065 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715068 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715071 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715074 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715078 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715082 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715085 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715090 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715094 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715096 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715099 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715101 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715103 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.720117 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715105 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715107 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715110 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715112 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715114 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715116 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715119 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715121 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715123 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715126 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715128 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715131 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715135 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715138 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715140 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.720921 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715143 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.715147 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715269 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715275 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715279 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715284 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715287 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715290 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715292 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715295 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715297 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715300 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715303 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715306 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 14:31:03.721438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715308 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715310 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715315 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715319 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715323 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715327 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715331 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715333 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715336 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715339 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715341 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715343 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715346 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715348 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715350 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715353 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715355 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715357 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715360 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715362 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 14:31:03.721831 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715364 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715366 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715369 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715371 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715373 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715375 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715378 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715380 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715383 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715385 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715387 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715390 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715393 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715397 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715401 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715405 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715410 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715412 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715414 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 14:31:03.722436 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715418 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715422 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715425 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715427 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715430 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715433 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715435 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715437 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715439 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715442 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715444 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715446 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715449 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715451 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715453 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715455 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715458 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715460 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715462 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715464 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 14 14:31:03.722915 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715468 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715471 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715475 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715479 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715483 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715488 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715491 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715493 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715496 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715499 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715501 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715503 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715505 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715508 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715510 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715512 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715515 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715517 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715519 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 14:31:03.723462 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715522 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715524 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715526 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715529 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715531 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715533 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715535 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:03.715538 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.715542 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.715636 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.717746 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.719083 2562 server.go:1019] "Starting client certificate rotation" Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.719201 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:31:03.723934 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.719299 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 14:31:03.724244 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.723638 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:31:03.728041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.728024 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 14:31:03.737899 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.737882 2562 log.go:25] "Validated CRI v1 runtime API" Jul 14 14:31:03.740019 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.740007 2562 log.go:25] "Validated CRI v1 image API" Jul 14 14:31:03.740816 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.740804 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 14:31:03.745815 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.745798 2562 fs.go:135] Filesystem UUIDs: map[1784aaec-4b0f-443e-90f6-56559438e93e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a205a0c6-5646-4a64-9b24-e7395d39bb48:/dev/nvme0n1p4] Jul 14 14:31:03.745872 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.745815 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 14:31:03.750169 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.750151 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:31:03.750897 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.750802 2562 manager.go:216] Machine: {Timestamp:2026-07-14 14:31:03.749520879 +0000 UTC m=+0.308710544 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3221349 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f1961d22870e4ace4ba082fdbddc7 SystemUUID:ec2f1961-d228-70e4-ace4-ba082fdbddc7 BootID:6fc07975-9d69-44f3-a8da-53a3de4d03cf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:ea:2d:1f:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:ea:2d:1f:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:f9:78:f0:25:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 14:31:03.750897 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.750894 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 14:31:03.751004 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.750962 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 14:31:03.753754 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.753733 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 14:31:03.753872 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.753756 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 14:31:03.754966 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.754956 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 14:31:03.754997 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.754969 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 14:31:03.754997 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.754976 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:31:03.755632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.755623 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 14:31:03.756949 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.756940 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 14:31:03.760388 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760378 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:31:03.760500 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760491 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 14:31:03.760532 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760524 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 14 14:31:03.760561 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760540 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 14:31:03.760561 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760554 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 14:31:03.760617 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760562 2562 kubelet.go:398] "Adding apiserver pod source" Jul 14 14:31:03.760617 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760571 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 14:31:03.760946 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760932 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:31:03.760992 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.760952 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 14:31:03.765897 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.765726 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 14:31:03.767646 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767631 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 14:31:03.767718 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767661 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 14:31:03.767840 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767828 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 14:31:03.767877 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767850 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 14:31:03.767877 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767862 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 14:31:03.767877 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767870 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 14:31:03.767877 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767878 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 14:31:03.767978 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.767883 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 14:31:03.768645 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768637 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 14:31:03.768691 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768646 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 14:31:03.768691 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768653 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 14:31:03.768691 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768658 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 14:31:03.768691 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768666 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 14:31:03.768691 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.768673 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 14:31:03.769509 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.769497 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 14:31:03.769509 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.769508 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 14:31:03.771443 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.771420 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 14:31:03.771443 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.771423 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 14:31:03.771443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.771448 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 14:31:03.772548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.772537 2562 server.go:1268] "Started kubelet" Jul 14 14:31:03.772701 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.772637 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 14:31:03.772701 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.772668 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 14:31:03.772846 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.772712 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 14:31:03.773276 ip-10-0-135-215 systemd[1]: Started Kubernetes Kubelet. Jul 14 14:31:03.774224 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.774207 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 14:31:03.775192 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.775164 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 14 14:31:03.778426 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.778408 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 14:31:03.778567 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.778553 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kgbd" Jul 14 14:31:03.779771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.779754 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 14:31:03.779846 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.779830 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 14:31:03.780283 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.780041 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:03.780602 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780544 2562 factory.go:55] Registering systemd factory Jul 14 14:31:03.780602 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780563 2562 factory.go:223] Registration of the systemd container factory successfully Jul 14 14:31:03.780602 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780548 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 14:31:03.780801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780624 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 14:31:03.780801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780635 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 14:31:03.780902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780806 2562 factory.go:153] Registering CRI-O factory Jul 14 14:31:03.780902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780857 2562 factory.go:223] Registration of the crio container factory successfully Jul 14 14:31:03.780902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780861 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 14 14:31:03.780902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780870 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 14 14:31:03.781041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780957 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 14:31:03.781041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780981 2562 factory.go:103] Registering Raw factory Jul 14 14:31:03.781041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.780996 2562 manager.go:1196] Started watching for new ooms in manager Jul 14 14:31:03.781585 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.781572 2562 manager.go:349] Starting recovery of all containers Jul 14 14:31:03.787611 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.787583 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kgbd" Jul 14 14:31:03.788206 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.788179 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 14:31:03.788282 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.788264 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 14:31:03.789005 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.787887 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-215.ec2.internal.18c22e70a7706090 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-215.ec2.internal,UID:ip-10-0-135-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-215.ec2.internal,},FirstTimestamp:2026-07-14 14:31:03.7725124 +0000 UTC m=+0.331702045,LastTimestamp:2026-07-14 14:31:03.7725124 +0000 UTC m=+0.331702045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-215.ec2.internal,}" Jul 14 14:31:03.791371 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.791208 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 14:31:03.792941 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.792928 2562 manager.go:354] Recovery completed Jul 14 14:31:03.797976 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.797959 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:03.799738 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.799723 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:03.799791 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.799750 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:03.799791 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.799759 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:03.800244 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800231 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 14:31:03.800244 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800243 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 14:31:03.800330 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800257 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 14 14:31:03.800330 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800269 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:03.800933 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800919 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:03.801011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800949 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:03.801011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.800963 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:03.801479 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.801467 2562 policy_none.go:49] "None policy: Start" Jul 14 14:31:03.801517 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.801501 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 14:31:03.801517 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.801511 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 14:31:03.801856 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.801769 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-215.ec2.internal.18c22e70a90fd007 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-215.ec2.internal,UID:ip-10-0-135-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-215.ec2.internal,},FirstTimestamp:2026-07-14 14:31:03.799738375 +0000 UTC m=+0.358928022,LastTimestamp:2026-07-14 14:31:03.799738375 +0000 UTC m=+0.358928022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-215.ec2.internal,}" Jul 14 14:31:03.802587 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.802575 2562 policy_none.go:47] "Start" Jul 14 14:31:03.845181 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845166 2562 manager.go:337] "Starting Device Plugin manager" Jul 14 14:31:03.845268 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.845191 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 14:31:03.845268 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845200 2562 server.go:87] "Starting device plugin registration server" Jul 14 14:31:03.845375 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845365 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 14:31:03.845420 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845377 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 14:31:03.845463 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845444 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 14:31:03.845538 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845523 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 14:31:03.845595 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.845539 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 14:31:03.845952 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.845932 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 14:31:03.846045 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.845979 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:03.946069 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.946051 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:03.947278 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.946812 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:03.947278 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.946839 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:03.947278 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.946848 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:03.947278 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.946870 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-215.ec2.internal" Jul 14 14:31:03.954255 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.954223 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-215.ec2.internal" Jul 14 14:31:03.954255 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.954243 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-215.ec2.internal\": node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:03.969790 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.969774 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:03.976932 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.976912 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 14:31:03.977001 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.976947 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 14:31:03.977001 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.976963 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 14:31:03.977001 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:03.976988 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 14:31:03.979146 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:03.979126 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:31:04.070305 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.070284 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.077455 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.077423 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal"] Jul 14 14:31:04.077516 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.077490 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:04.078259 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.078246 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:04.078316 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.078270 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:04.078316 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.078280 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:04.079775 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.079765 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:04.079924 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.079912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.079956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.079940 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:04.082120 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.082172 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe91a953528a902b98bd89fe9453b0a7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-215.ec2.internal\" (UID: \"fe91a953528a902b98bd89fe9453b0a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.082172 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.082865 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082845 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:04.082945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082869 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:04.082945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082880 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:04.082945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082894 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:04.082945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082915 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:04.082945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.082929 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:04.084232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.084219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.084275 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.084244 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 14:31:04.084898 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.084884 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientMemory" Jul 14 14:31:04.084990 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.084904 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 14:31:04.084990 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.084917 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeHasSufficientPID" Jul 14 14:31:04.099191 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.099173 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-215.ec2.internal\" not found" node="ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.102378 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.102362 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-215.ec2.internal\" not found" node="ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.171150 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.171120 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.182478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.182548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.182548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe91a953528a902b98bd89fe9453b0a7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-215.ec2.internal\" (UID: \"fe91a953528a902b98bd89fe9453b0a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.182548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe91a953528a902b98bd89fe9453b0a7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-215.ec2.internal\" (UID: \"fe91a953528a902b98bd89fe9453b0a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.182548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.182702 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.182561 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c01cd591f655ced89d5c698fd66678c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal\" (UID: \"c01cd591f655ced89d5c698fd66678c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.271861 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.271844 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.372324 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.372304 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.400838 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.400817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.405570 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.405557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:04.472689 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.472662 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.573190 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.573147 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.673719 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.673701 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.718922 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.718903 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 14:31:04.719329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.719002 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 14:31:04.719569 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.719554 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:31:04.774209 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.774191 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.791873 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.791844 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 14:26:04 +0000 UTC" deadline="2028-04-18 05:32:14.285825604 +0000 UTC" Jul 14 14:31:04.791873 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.791870 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15447h1m9.493959711s" Jul 14 14:31:04.876065 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.876020 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.978020 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:04.977994 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-215.ec2.internal\" not found" Jul 14 14:31:04.989629 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:04.989605 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:31:05.081099 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.081078 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" Jul 14 14:31:05.094079 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.094061 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:31:05.095261 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.095249 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" Jul 14 14:31:05.103971 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.103957 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 14:31:05.351945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.351920 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:31:05.761933 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.761907 2562 apiserver.go:52] "Watching apiserver" Jul 14 14:31:05.768769 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.768730 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 14:31:05.772105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.772079 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-l5fdl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal","openshift-multus/multus-additional-cni-plugins-ppg4l","kube-system/global-pull-secret-syncer-k5d8w","kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal","openshift-dns/node-resolver-pv6nq","openshift-multus/multus-mss5x","openshift-multus/network-metrics-daemon-bd9nk","openshift-network-diagnostics/network-check-target-bqzl7","openshift-network-operator/iptables-alerter-ldxcb","openshift-ovn-kubernetes/ovnkube-node-9d58s","kube-system/konnectivity-agent-jfm8m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5","openshift-cluster-node-tuning-operator/tuned-4bd4k"] Jul 14 14:31:05.774124 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.774106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.775503 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.775482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.776748 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.776727 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 14:31:05.776748 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.776761 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-blvss\"" Jul 14 14:31:05.777039 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777015 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.777104 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.777159 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.777159 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777122 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 14:31:05.777763 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777741 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 14:31:05.777763 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rv8xm\"" Jul 14 14:31:05.777913 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.777741 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 14:31:05.778069 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.778054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.778159 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.778143 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 14:31:05.778580 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.778553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.778679 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.778631 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:05.778782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.778759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.778886 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.778829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 14:31:05.779382 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.779359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 14:31:05.779471 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.779407 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jbh8\"" Jul 14 14:31:05.780047 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.780030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 14:31:05.780106 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.780052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.780628 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.780612 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 14:31:05.781838 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.781822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.782186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.782170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wg7cq\"" Jul 14 14:31:05.782272 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.782188 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.782272 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.782266 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.783481 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.783470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:05.783554 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.783538 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:05.783989 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.783975 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.784196 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.784180 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.784196 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.784189 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c45lb\"" Jul 14 14:31:05.784881 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.784865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.786805 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.786782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 14:31:05.786896 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.786848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:05.786958 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.786916 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:05.786958 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.786953 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.787108 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.787034 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.787419 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.787403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7bn78\"" Jul 14 14:31:05.788554 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.788535 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.790423 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.790403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.790905 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.790827 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 14:31:05.790905 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.790848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.791106 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791094 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-htgkv\"" Jul 14 14:31:05.791681 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-os-release\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.791718 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-multus\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.791776 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-multus-certs\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.791776 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-node-log\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.791861 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-system-cni-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.791861 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-conf\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.791936 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cni-binary-copy\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.791936 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-daemon-config\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.791936 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-kubelet\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-env-overrides\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.791991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-bin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pncgv\" (UniqueName: \"kubernetes.io/projected/44e66830-01ad-4755-bf81-9de5e6c504b0-kube-api-access-pncgv\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-etc-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-host\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-k8s-cni-cncf-io\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-etc-kubernetes\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-dbus\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q54lz\" (UniqueName: \"kubernetes.io/projected/710ff849-bbba-4bee-bc62-240b56c9f52d-kube-api-access-q54lz\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.792240 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysconfig\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-lib-modules\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-kubelet\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-conf-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-slash\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2h2r\" (UniqueName: \"kubernetes.io/projected/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-kube-api-access-p2h2r\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cnibin\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-os-release\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792469 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-systemd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.792548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-netns\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792594 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-var-lib-kubelet\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-modprobe-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-systemd-units\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-systemd\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-run\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/710ff849-bbba-4bee-bc62-240b56c9f52d-hosts-file\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/710ff849-bbba-4bee-bc62-240b56c9f52d-tmp-dir\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-var-lib-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792851 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pdgz2\"" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-netd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.792996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-socket-dir-parent\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-netns\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.793154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-log-socket\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e66830-01ad-4755-bf81-9de5e6c504b0-ovn-node-metrics-cert\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-kubernetes\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-sys\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-tmp\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-hostroot\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-ovn\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whn7\" (UniqueName: \"kubernetes.io/projected/19765fe1-cdad-48ac-9807-e50a6a88c821-kube-api-access-2whn7\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2lt2\" (UniqueName: \"kubernetes.io/projected/b5fefca1-d12a-49f7-b7ee-6560df1223a7-kube-api-access-c2lt2\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.793802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-script-lib\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.794303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-kubelet-config\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.794303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.793890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-tuned\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.794303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.794172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cnibin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.794303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.794219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-bin\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.794506 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.794252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-config\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.794506 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.794406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-system-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.795490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.795467 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 14:31:05.795586 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.795551 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wpl8p\"" Jul 14 14:31:05.795803 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.795785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 14:31:05.795888 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.795805 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 14:31:05.815400 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.815377 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-96lpg" Jul 14 14:31:05.818138 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:05.818105 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe91a953528a902b98bd89fe9453b0a7.slice/crio-3477f55f0d332e3825d8ac4e1e59d4635b884daebb8ab58fca721221d78f1799 WatchSource:0}: Error finding container 3477f55f0d332e3825d8ac4e1e59d4635b884daebb8ab58fca721221d78f1799: Status 404 returned error can't find the container with id 3477f55f0d332e3825d8ac4e1e59d4635b884daebb8ab58fca721221d78f1799 Jul 14 14:31:05.823250 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.823142 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-96lpg" Jul 14 14:31:05.823721 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.823705 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:31:05.842980 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:05.842960 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01cd591f655ced89d5c698fd66678c1.slice/crio-44a0de8272870506243196ac4160411e5dae0c662c82dff36f174c531cc9dfdd WatchSource:0}: Error finding container 44a0de8272870506243196ac4160411e5dae0c662c82dff36f174c531cc9dfdd: Status 404 returned error can't find the container with id 44a0de8272870506243196ac4160411e5dae0c662c82dff36f174c531cc9dfdd Jul 14 14:31:05.881421 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.881400 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 14:31:05.894932 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.894913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-etc-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.895010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.894942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.895010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.894964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-host\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.894977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-etc-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.895010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.894984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hbpt\" (UniqueName: \"kubernetes.io/projected/856b22c4-2e5c-406e-ae93-1d35bbb744b7-kube-api-access-6hbpt\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-host\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-k8s-cni-cncf-io\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895097 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-k8s-cni-cncf-io\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-etc-kubernetes\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-etc-kubernetes\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-dbus\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54lz\" (UniqueName: \"kubernetes.io/projected/710ff849-bbba-4bee-bc62-240b56c9f52d-kube-api-access-q54lz\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.895223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrkn\" (UniqueName: \"kubernetes.io/projected/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-kube-api-access-ckrkn\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysconfig\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-lib-modules\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-kubelet\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysconfig\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-conf-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-slash\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2h2r\" (UniqueName: \"kubernetes.io/projected/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-kube-api-access-p2h2r\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-kubelet\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895438 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cnibin\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-lib-modules\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895293 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-dbus\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-slash\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.895624 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895490 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-conf-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-os-release\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895523 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895586 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cnibin\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-systemd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-systemd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895625 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-os-release\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-netns\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-var-lib-kubelet\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895750 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-netns\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895766 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-modprobe-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-var-lib-kubelet\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-systemd-units\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-systemd-units\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-systemd\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.896329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-modprobe-d\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-run\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895889 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-systemd\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/710ff849-bbba-4bee-bc62-240b56c9f52d-hosts-file\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/710ff849-bbba-4bee-bc62-240b56c9f52d-tmp-dir\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-socket-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.895956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-var-lib-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/710ff849-bbba-4bee-bc62-240b56c9f52d-hosts-file\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896026 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-run\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-netd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896060 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-var-lib-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5686109b-f12b-42a6-ae2e-dce0ca3129c6-serviceca\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-netd\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896204 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/710ff849-bbba-4bee-bc62-240b56c9f52d-tmp-dir\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14b3c577-3fda-4574-b2a3-ca24f1216d51-agent-certs\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/856b22c4-2e5c-406e-ae93-1d35bbb744b7-host-slash\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.897088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-socket-dir-parent\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnd74\" (UniqueName: \"kubernetes.io/projected/497cae3e-8c8c-46f4-985b-8c7290a3582c-kube-api-access-gnd74\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896309 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-socket-dir-parent\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-netns\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896352 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-openvswitch\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-log-socket\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e66830-01ad-4755-bf81-9de5e6c504b0-ovn-node-metrics-cert\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-kubernetes\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-netns\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-sys\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-tmp\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-log-socket\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896442 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896469 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-kubernetes\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-sys\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-registration-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-hostroot\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-ovn\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896619 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-hostroot\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896662 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-run-ovn\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whn7\" (UniqueName: \"kubernetes.io/projected/19765fe1-cdad-48ac-9807-e50a6a88c821-kube-api-access-2whn7\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjxvz\" (UniqueName: \"kubernetes.io/projected/5686109b-f12b-42a6-ae2e-dce0ca3129c6-kube-api-access-bjxvz\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896695 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14b3c577-3fda-4574-b2a3-ca24f1216d51-konnectivity-ca\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2lt2\" (UniqueName: \"kubernetes.io/projected/b5fefca1-d12a-49f7-b7ee-6560df1223a7-kube-api-access-c2lt2\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-script-lib\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-kubelet-config\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-tuned\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-kubelet-config\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cnibin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.898860 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.896961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-bin\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cnibin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-cni-bin\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-config\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5686109b-f12b-42a6-ae2e-dce0ca3129c6-host\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-system-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-os-release\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-multus\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-multus-certs\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-node-log\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-sys-fs\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/856b22c4-2e5c-406e-ae93-1d35bbb744b7-iptables-alerter-script\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-system-cni-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-conf\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cni-binary-copy\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.897391 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-daemon-config\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.899734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-kubelet\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-env-overrides\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897687 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-system-cni-dir\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-config\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-kubelet\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897773 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897828 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-system-cni-dir\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897836 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-ovnkube-script-lib\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-bin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.897884 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:06.397859697 +0000 UTC m=+2.957049338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-device-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897936 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-os-release\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.897972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-sysctl-conf\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-node-log\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.900434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898011 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-run-multus-certs\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-bin\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5fefca1-d12a-49f7-b7ee-6560df1223a7-host-var-lib-cni-multus\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e66830-01ad-4755-bf81-9de5e6c504b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pncgv\" (UniqueName: \"kubernetes.io/projected/44e66830-01ad-4755-bf81-9de5e6c504b0-kube-api-access-pncgv\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44e66830-01ad-4755-bf81-9de5e6c504b0-env-overrides\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898572 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-cni-binary-copy\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5fefca1-d12a-49f7-b7ee-6560df1223a7-multus-daemon-config\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.898828 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.900318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44e66830-01ad-4755-bf81-9de5e6c504b0-ovn-node-metrics-cert\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.900844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-etc-tuned\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.901029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.900907 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19765fe1-cdad-48ac-9807-e50a6a88c821-tmp\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.902905 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.902883 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54lz\" (UniqueName: \"kubernetes.io/projected/710ff849-bbba-4bee-bc62-240b56c9f52d-kube-api-access-q54lz\") pod \"node-resolver-pv6nq\" (UID: \"710ff849-bbba-4bee-bc62-240b56c9f52d\") " pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:05.903272 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.903256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2h2r\" (UniqueName: \"kubernetes.io/projected/a8ae5192-2faa-4dd3-9975-7b06cf8fc06d-kube-api-access-p2h2r\") pod \"multus-additional-cni-plugins-ppg4l\" (UID: \"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d\") " pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:05.905089 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.905068 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whn7\" (UniqueName: \"kubernetes.io/projected/19765fe1-cdad-48ac-9807-e50a6a88c821-kube-api-access-2whn7\") pod \"tuned-4bd4k\" (UID: \"19765fe1-cdad-48ac-9807-e50a6a88c821\") " pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:05.906905 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.906890 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2lt2\" (UniqueName: \"kubernetes.io/projected/b5fefca1-d12a-49f7-b7ee-6560df1223a7-kube-api-access-c2lt2\") pod \"multus-mss5x\" (UID: \"b5fefca1-d12a-49f7-b7ee-6560df1223a7\") " pod="openshift-multus/multus-mss5x" Jul 14 14:31:05.907077 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.907059 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pncgv\" (UniqueName: \"kubernetes.io/projected/44e66830-01ad-4755-bf81-9de5e6c504b0-kube-api-access-pncgv\") pod \"ovnkube-node-9d58s\" (UID: \"44e66830-01ad-4755-bf81-9de5e6c504b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:05.980986 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.980912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" event={"ID":"c01cd591f655ced89d5c698fd66678c1","Type":"ContainerStarted","Data":"44a0de8272870506243196ac4160411e5dae0c662c82dff36f174c531cc9dfdd"} Jul 14 14:31:05.981965 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.981947 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" event={"ID":"fe91a953528a902b98bd89fe9453b0a7","Type":"ContainerStarted","Data":"3477f55f0d332e3825d8ac4e1e59d4635b884daebb8ab58fca721221d78f1799"} Jul 14 14:31:05.998858 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-socket-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5686109b-f12b-42a6-ae2e-dce0ca3129c6-serviceca\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14b3c577-3fda-4574-b2a3-ca24f1216d51-agent-certs\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/856b22c4-2e5c-406e-ae93-1d35bbb744b7-host-slash\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnd74\" (UniqueName: \"kubernetes.io/projected/497cae3e-8c8c-46f4-985b-8c7290a3582c-kube-api-access-gnd74\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.998952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-registration-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.998971 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/856b22c4-2e5c-406e-ae93-1d35bbb744b7-host-slash\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-registration-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999017 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-socket-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.999043 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:05.999095 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:06.499075887 +0000 UTC m=+3.058265522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjxvz\" (UniqueName: \"kubernetes.io/projected/5686109b-f12b-42a6-ae2e-dce0ca3129c6-kube-api-access-bjxvz\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14b3c577-3fda-4574-b2a3-ca24f1216d51-konnectivity-ca\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5686109b-f12b-42a6-ae2e-dce0ca3129c6-host\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.999236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-sys-fs\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/856b22c4-2e5c-406e-ae93-1d35bbb744b7-iptables-alerter-script\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5686109b-f12b-42a6-ae2e-dce0ca3129c6-host\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5686109b-f12b-42a6-ae2e-dce0ca3129c6-serviceca\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999328 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-sys-fs\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-device-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hbpt\" (UniqueName: \"kubernetes.io/projected/856b22c4-2e5c-406e-ae93-1d35bbb744b7-kube-api-access-6hbpt\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999362 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-etc-selinux\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999391 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/497cae3e-8c8c-46f4-985b-8c7290a3582c-device-dir\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:05.999724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrkn\" (UniqueName: \"kubernetes.io/projected/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-kube-api-access-ckrkn\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:06.000227 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14b3c577-3fda-4574-b2a3-ca24f1216d51-konnectivity-ca\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:06.000227 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:05.999916 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/856b22c4-2e5c-406e-ae93-1d35bbb744b7-iptables-alerter-script\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:06.001099 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.001080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14b3c577-3fda-4574-b2a3-ca24f1216d51-agent-certs\") pod \"konnectivity-agent-jfm8m\" (UID: \"14b3c577-3fda-4574-b2a3-ca24f1216d51\") " pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:06.005352 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.005333 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:06.005352 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.005354 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:06.005498 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.005366 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:06.005498 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.005424 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:06.505405471 +0000 UTC m=+3.064595107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:06.007298 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.007267 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjxvz\" (UniqueName: \"kubernetes.io/projected/5686109b-f12b-42a6-ae2e-dce0ca3129c6-kube-api-access-bjxvz\") pod \"node-ca-l5fdl\" (UID: \"5686109b-f12b-42a6-ae2e-dce0ca3129c6\") " pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:06.007438 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.007421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hbpt\" (UniqueName: \"kubernetes.io/projected/856b22c4-2e5c-406e-ae93-1d35bbb744b7-kube-api-access-6hbpt\") pod \"iptables-alerter-ldxcb\" (UID: \"856b22c4-2e5c-406e-ae93-1d35bbb744b7\") " pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:06.007669 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.007654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnd74\" (UniqueName: \"kubernetes.io/projected/497cae3e-8c8c-46f4-985b-8c7290a3582c-kube-api-access-gnd74\") pod \"aws-ebs-csi-driver-node-hjvl5\" (UID: \"497cae3e-8c8c-46f4-985b-8c7290a3582c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:06.007837 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.007821 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrkn\" (UniqueName: \"kubernetes.io/projected/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-kube-api-access-ckrkn\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:06.096832 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.096814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mss5x" Jul 14 14:31:06.102948 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.102932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:06.105518 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.105496 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fefca1_d12a_49f7_b7ee_6560df1223a7.slice/crio-e0da16d26134183b6de88d1f204e3e5b97d3fe27241608ec73b6fe8be068061a WatchSource:0}: Error finding container e0da16d26134183b6de88d1f204e3e5b97d3fe27241608ec73b6fe8be068061a: Status 404 returned error can't find the container with id e0da16d26134183b6de88d1f204e3e5b97d3fe27241608ec73b6fe8be068061a Jul 14 14:31:06.110803 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.110782 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e66830_01ad_4755_bf81_9de5e6c504b0.slice/crio-910669f8c75ba6515fff17d13e5c8fb2ebccc1c4e6f1fe586fbd0e075a61f44e WatchSource:0}: Error finding container 910669f8c75ba6515fff17d13e5c8fb2ebccc1c4e6f1fe586fbd0e075a61f44e: Status 404 returned error can't find the container with id 910669f8c75ba6515fff17d13e5c8fb2ebccc1c4e6f1fe586fbd0e075a61f44e Jul 14 14:31:06.125166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.125147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" Jul 14 14:31:06.129678 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.129660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" Jul 14 14:31:06.133139 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.133116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ae5192_2faa_4dd3_9975_7b06cf8fc06d.slice/crio-e211da891b368606a85960b301aa1e26c29ac2389f1b74df52230246a0fd8754 WatchSource:0}: Error finding container e211da891b368606a85960b301aa1e26c29ac2389f1b74df52230246a0fd8754: Status 404 returned error can't find the container with id e211da891b368606a85960b301aa1e26c29ac2389f1b74df52230246a0fd8754 Jul 14 14:31:06.134814 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.134797 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pv6nq" Jul 14 14:31:06.137438 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.137419 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19765fe1_cdad_48ac_9807_e50a6a88c821.slice/crio-6c81653b45a0043d73030e0218919d4b000e26bcda6bc9012bf211f280c2d556 WatchSource:0}: Error finding container 6c81653b45a0043d73030e0218919d4b000e26bcda6bc9012bf211f280c2d556: Status 404 returned error can't find the container with id 6c81653b45a0043d73030e0218919d4b000e26bcda6bc9012bf211f280c2d556 Jul 14 14:31:06.142053 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.142034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710ff849_bbba_4bee_bc62_240b56c9f52d.slice/crio-7f76d79790202c615e4012b57fd90c7a408473a89cbb692eec6d16fabf8699de WatchSource:0}: Error finding container 7f76d79790202c615e4012b57fd90c7a408473a89cbb692eec6d16fabf8699de: Status 404 returned error can't find the container with id 7f76d79790202c615e4012b57fd90c7a408473a89cbb692eec6d16fabf8699de Jul 14 14:31:06.142964 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.142945 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" Jul 14 14:31:06.148537 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.148508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ldxcb" Jul 14 14:31:06.151449 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.151430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497cae3e_8c8c_46f4_985b_8c7290a3582c.slice/crio-8652430ab7d7756bed6753ccf67e2347c7aac7f1452930147c6edfc117011ecc WatchSource:0}: Error finding container 8652430ab7d7756bed6753ccf67e2347c7aac7f1452930147c6edfc117011ecc: Status 404 returned error can't find the container with id 8652430ab7d7756bed6753ccf67e2347c7aac7f1452930147c6edfc117011ecc Jul 14 14:31:06.154729 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.154712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5fdl" Jul 14 14:31:06.156547 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.156528 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856b22c4_2e5c_406e_ae93_1d35bbb744b7.slice/crio-3de78ae3aa83557b1bf9b67e110f758d756f6c47a44b69921761deb2327d5e88 WatchSource:0}: Error finding container 3de78ae3aa83557b1bf9b67e110f758d756f6c47a44b69921761deb2327d5e88: Status 404 returned error can't find the container with id 3de78ae3aa83557b1bf9b67e110f758d756f6c47a44b69921761deb2327d5e88 Jul 14 14:31:06.159530 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.159502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:06.164480 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.164460 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5686109b_f12b_42a6_ae2e_dce0ca3129c6.slice/crio-2a98777eb892b7b3ae11a227d1ecabeeb0bf2abb9f2aa3eda8a9b57728b828be WatchSource:0}: Error finding container 2a98777eb892b7b3ae11a227d1ecabeeb0bf2abb9f2aa3eda8a9b57728b828be: Status 404 returned error can't find the container with id 2a98777eb892b7b3ae11a227d1ecabeeb0bf2abb9f2aa3eda8a9b57728b828be Jul 14 14:31:06.168840 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:06.168822 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b3c577_3fda_4574_b2a3_ca24f1216d51.slice/crio-ac2fb2a34f0375a64be56151986c0deefb6e8c95a2ab1084143dcea0c6ffcb2e WatchSource:0}: Error finding container ac2fb2a34f0375a64be56151986c0deefb6e8c95a2ab1084143dcea0c6ffcb2e: Status 404 returned error can't find the container with id ac2fb2a34f0375a64be56151986c0deefb6e8c95a2ab1084143dcea0c6ffcb2e Jul 14 14:31:06.197166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.197144 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 14:31:06.401123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.401095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:06.401291 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.401275 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:06.401358 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.401340 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:07.401320827 +0000 UTC m=+3.960510481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:06.502342 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.502310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:06.502520 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.502497 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:06.502605 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.502569 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:07.502550202 +0000 UTC m=+4.061739839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:06.602754 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.602716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:06.602930 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.602904 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:06.602930 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.602930 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:06.603046 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.602943 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:06.603046 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:06.603019 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:07.602998276 +0000 UTC m=+4.162187947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:06.825108 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.825066 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:26:06 +0000 UTC" deadline="2028-01-22 02:41:33.108543567 +0000 UTC" Jul 14 14:31:06.825108 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.825103 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13356h10m26.283444884s" Jul 14 14:31:06.987546 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.987385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5fdl" event={"ID":"5686109b-f12b-42a6-ae2e-dce0ca3129c6","Type":"ContainerStarted","Data":"2a98777eb892b7b3ae11a227d1ecabeeb0bf2abb9f2aa3eda8a9b57728b828be"} Jul 14 14:31:06.989512 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.989435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ldxcb" event={"ID":"856b22c4-2e5c-406e-ae93-1d35bbb744b7","Type":"ContainerStarted","Data":"3de78ae3aa83557b1bf9b67e110f758d756f6c47a44b69921761deb2327d5e88"} Jul 14 14:31:06.994503 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.994438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" event={"ID":"19765fe1-cdad-48ac-9807-e50a6a88c821","Type":"ContainerStarted","Data":"6c81653b45a0043d73030e0218919d4b000e26bcda6bc9012bf211f280c2d556"} Jul 14 14:31:06.997039 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:06.997015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"910669f8c75ba6515fff17d13e5c8fb2ebccc1c4e6f1fe586fbd0e075a61f44e"} Jul 14 14:31:07.001397 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.001367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mss5x" event={"ID":"b5fefca1-d12a-49f7-b7ee-6560df1223a7","Type":"ContainerStarted","Data":"e0da16d26134183b6de88d1f204e3e5b97d3fe27241608ec73b6fe8be068061a"} Jul 14 14:31:07.003588 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.003538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfm8m" event={"ID":"14b3c577-3fda-4574-b2a3-ca24f1216d51","Type":"ContainerStarted","Data":"ac2fb2a34f0375a64be56151986c0deefb6e8c95a2ab1084143dcea0c6ffcb2e"} Jul 14 14:31:07.019131 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.018898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" event={"ID":"497cae3e-8c8c-46f4-985b-8c7290a3582c","Type":"ContainerStarted","Data":"8652430ab7d7756bed6753ccf67e2347c7aac7f1452930147c6edfc117011ecc"} Jul 14 14:31:07.023923 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.022794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pv6nq" event={"ID":"710ff849-bbba-4bee-bc62-240b56c9f52d","Type":"ContainerStarted","Data":"7f76d79790202c615e4012b57fd90c7a408473a89cbb692eec6d16fabf8699de"} Jul 14 14:31:07.025116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.025046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerStarted","Data":"e211da891b368606a85960b301aa1e26c29ac2389f1b74df52230246a0fd8754"} Jul 14 14:31:07.410478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.409804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:07.410478 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.409988 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:07.410478 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.410108 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:09.410092604 +0000 UTC m=+5.969282238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:07.511041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.510972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:07.511277 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.511258 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:07.511349 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.511331 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:09.511312089 +0000 UTC m=+6.070501728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:07.612575 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.612535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:07.612780 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.612712 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:07.612780 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.612758 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:07.612780 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.612772 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:07.612958 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.612833 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:09.612813325 +0000 UTC m=+6.172002969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:07.825726 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.825641 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 14:26:06 +0000 UTC" deadline="2028-03-15 00:01:26.477009829 +0000 UTC" Jul 14 14:31:07.826286 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.825743 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14625h30m18.651271921s" Jul 14 14:31:07.987435 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.987407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:07.987635 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.987542 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:07.987987 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.987967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:07.988080 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.988064 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:07.988140 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:07.988125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:07.988218 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:07.988198 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:09.427747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.427592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:09.428191 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.427797 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:09.428191 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.427889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:13.427865579 +0000 UTC m=+9.987055235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:09.528937 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.528262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:09.528937 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.528465 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:09.528937 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.528536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:13.528514974 +0000 UTC m=+10.087704614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:09.629092 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.629041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:09.629280 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.629236 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:09.629280 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.629256 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:09.629280 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.629269 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:09.629439 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.629325 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:13.629306194 +0000 UTC m=+10.188495829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:09.982507 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.982417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:09.982662 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.982537 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:09.982857 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.982829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:09.982987 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.982962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:09.983057 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:09.983024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:09.983162 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:09.983139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:11.977549 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:11.977514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:11.978072 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:11.977671 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:11.978072 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:11.977515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:11.978189 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:11.978093 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:11.978255 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:11.978223 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:11.978371 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:11.978343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:13.460548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.460497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:13.461061 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.460674 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:13.461061 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.460774 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:21.460751709 +0000 UTC m=+18.019941347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:13.561867 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.561829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:13.562021 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.562000 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:13.562093 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.562074 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:21.562045116 +0000 UTC m=+18.121234752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:13.663097 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.662471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:13.663097 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.662640 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:13.663097 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.662661 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:13.663097 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.662684 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:13.663097 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.662765 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:21.662745074 +0000 UTC m=+18.221934710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:13.978592 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.978559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:13.978770 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.978666 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:13.978833 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.978780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:13.978936 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.978881 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:13.979041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:13.979024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:13.979198 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:13.979175 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:15.979708 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:15.979646 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:15.980141 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:15.979834 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:15.980259 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:15.980244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:15.980370 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:15.980346 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:15.980456 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:15.980428 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:15.980536 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:15.980519 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:17.977736 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:17.977487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:17.978136 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:17.977491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:17.978136 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:17.977841 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:17.978136 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:17.977528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:17.978136 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:17.977928 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:17.978136 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:17.977972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:19.977560 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:19.977527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:19.978063 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:19.977658 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:19.978118 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:19.978069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:19.978191 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:19.978165 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:19.978318 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:19.978301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:19.978431 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:19.978398 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:21.525655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.525616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:21.526153 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.525777 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:21.526153 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.525852 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:37.5258326 +0000 UTC m=+34.085022250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:21.626394 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.626353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:21.626573 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.626483 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:21.626573 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.626551 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:37.626532263 +0000 UTC m=+34.185721898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:21.727053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.727011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:21.727217 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.727192 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:21.727268 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.727220 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:21.727268 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.727234 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:21.727358 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.727289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:31:37.727274473 +0000 UTC m=+34.286464106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:21.977445 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.977419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:21.977606 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.977426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:21.977606 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.977528 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:21.977606 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:21.977539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:21.977750 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.977597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:21.977750 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:21.977668 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:23.978536 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:23.978503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:23.978976 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:23.978585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:23.978976 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:23.978616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:23.978976 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:23.978672 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:23.978976 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:23.978708 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:23.978976 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:23.978792 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:25.977449 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:25.977408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:25.977449 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:25.977441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:25.978016 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:25.977536 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:25.978016 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:25.977601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:25.978016 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:25.977622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:25.978016 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:25.977755 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:27.069656 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.069622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" event={"ID":"19765fe1-cdad-48ac-9807-e50a6a88c821","Type":"ContainerStarted","Data":"7e8e877a80ac94b4231af45dfc466af3b9e7be3c9ab4f3d0edb68f08af0e57af"} Jul 14 14:31:27.071919 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.071890 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:31:27.072311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.072286 2562 generic.go:356] "Generic (PLEG): container finished" podID="44e66830-01ad-4755-bf81-9de5e6c504b0" containerID="4813492ec37a48c2ee1f8e64f25ffb3b491506bc6f0dec763e593996c13af852" exitCode=1 Jul 14 14:31:27.072394 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.072354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerDied","Data":"4813492ec37a48c2ee1f8e64f25ffb3b491506bc6f0dec763e593996c13af852"} Jul 14 14:31:27.072437 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.072418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"e74bc2cbc4792393f1c60c0a9fed1893cbec644ad1a9c99a08eb7a4c4b01b362"} Jul 14 14:31:27.074616 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.074586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mss5x" event={"ID":"b5fefca1-d12a-49f7-b7ee-6560df1223a7","Type":"ContainerStarted","Data":"e81e3a41cfdcfc138f28937bda0c7acc673d83f48da8e885b3d658412e56f44f"} Jul 14 14:31:27.076210 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.076192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" event={"ID":"fe91a953528a902b98bd89fe9453b0a7","Type":"ContainerStarted","Data":"8854a2effe78725d41a6f423abaa3cbffa5a097b9314039583ec4db7369b3942"} Jul 14 14:31:27.103432 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.103365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mss5x" podStartSLOduration=2.589776411 podStartE2EDuration="23.103343555s" totalImagesPullingTime="20.513567144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:27.103334267 +0000 UTC m=+23.662523944" watchObservedRunningTime="2026-07-14 14:31:27.103343555 +0000 UTC m=+23.662533211" Jul 14 14:31:27.104154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.104112 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4bd4k" podStartSLOduration=2.635674081 podStartE2EDuration="23.104101453s" totalImagesPullingTime="20.468427372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:27.08713936 +0000 UTC m=+23.646329035" watchObservedRunningTime="2026-07-14 14:31:27.104101453 +0000 UTC m=+23.663291109" Jul 14 14:31:27.115824 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.115774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-215.ec2.internal" podStartSLOduration=22.115761294 podStartE2EDuration="22.115761294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:27.115555807 +0000 UTC m=+23.674745473" watchObservedRunningTime="2026-07-14 14:31:27.115761294 +0000 UTC m=+23.674950948" Jul 14 14:31:27.977769 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.977746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:27.977926 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:27.977845 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:27.977926 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.977746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:27.977926 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:27.977863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:27.977926 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:27.977919 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:27.978065 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:27.978037 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:28.079013 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.078989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jfm8m" event={"ID":"14b3c577-3fda-4574-b2a3-ca24f1216d51","Type":"ContainerStarted","Data":"2f4a8fe4eba057482b6dbe01a72d5a251b092fd7c0ae9bb6716067f7115514a6"} Jul 14 14:31:28.080523 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.080503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" event={"ID":"497cae3e-8c8c-46f4-985b-8c7290a3582c","Type":"ContainerStarted","Data":"4fcdd0102276d16ee4669e04573ec99d7987297b811a8d916424d6d17fa43a16"} Jul 14 14:31:28.081946 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.081926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pv6nq" event={"ID":"710ff849-bbba-4bee-bc62-240b56c9f52d","Type":"ContainerStarted","Data":"e56d5367c69b04074dbe4d48a250a8532a992bcb0e315c8ff2a9ac50d7627b13"} Jul 14 14:31:28.083491 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.083342 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="9f35e94f2d2127d2ece8ae81a33e139440a9f98dafaa3626b4f63f9a4477c8d9" exitCode=0 Jul 14 14:31:28.083572 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.083420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"9f35e94f2d2127d2ece8ae81a33e139440a9f98dafaa3626b4f63f9a4477c8d9"} Jul 14 14:31:28.085377 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.084891 2562 generic.go:356] "Generic (PLEG): container finished" podID="c01cd591f655ced89d5c698fd66678c1" containerID="b1152baf9293239a6d26f4e6948e4f940d4ac4670277b19fc860f4b5d6bbf120" exitCode=0 Jul 14 14:31:28.085377 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.084938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" event={"ID":"c01cd591f655ced89d5c698fd66678c1","Type":"ContainerDied","Data":"b1152baf9293239a6d26f4e6948e4f940d4ac4670277b19fc860f4b5d6bbf120"} Jul 14 14:31:28.088690 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.088652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5fdl" event={"ID":"5686109b-f12b-42a6-ae2e-dce0ca3129c6","Type":"ContainerStarted","Data":"1e56efa77c6cc5ebd0478c06920decbd07f6a70cc3a59667a3869c0c2cb24ed7"} Jul 14 14:31:28.090023 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.090003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ldxcb" event={"ID":"856b22c4-2e5c-406e-ae93-1d35bbb744b7","Type":"ContainerStarted","Data":"0ca2d52629b9c1f56e8f7bdac69fa67d0c43ad1a1839356a9a39bec5ad374489"} Jul 14 14:31:28.092762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.092747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:31:28.093144 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.093122 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"27bab013114543ad215ef66c1aa87427786d118d20bc83291b47fbc88531ae1c"} Jul 14 14:31:28.093231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.093177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"80eb3a52421d025d21f2030e5b3fe721556550bc877aa063d2e9a2609cba6b4c"} Jul 14 14:31:28.093231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.093207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"fa5de9d200c03415532313317ae104c914563d5483c7381869cf0042cd500095"} Jul 14 14:31:28.093344 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.093235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"af36e72ad8cea626b864d5442f423d2fd178568acb409831eb47f5d0e40523c5"} Jul 14 14:31:28.095547 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.095515 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jfm8m" podStartSLOduration=3.697184211 podStartE2EDuration="24.095504079s" totalImagesPullingTime="20.398319868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:28.095345138 +0000 UTC m=+24.654534796" watchObservedRunningTime="2026-07-14 14:31:28.095504079 +0000 UTC m=+24.654693745" Jul 14 14:31:28.146790 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.146752 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l5fdl" podStartSLOduration=3.725867667 podStartE2EDuration="24.146736567s" totalImagesPullingTime="20.4208689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:28.132841811 +0000 UTC m=+24.692031498" watchObservedRunningTime="2026-07-14 14:31:28.146736567 +0000 UTC m=+24.705926222" Jul 14 14:31:28.450489 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.450383 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:28.504632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.504592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:28.568602 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.568566 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:28.569248 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.569231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:28.584231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:28.584187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pv6nq" podStartSLOduration=4.140892081 podStartE2EDuration="24.584172634s" totalImagesPullingTime="20.443280553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:28.161614358 +0000 UTC m=+24.720804014" watchObservedRunningTime="2026-07-14 14:31:28.584172634 +0000 UTC m=+25.143362348" Jul 14 14:31:29.073993 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.073928 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 14:31:29.097775 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.097745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" event={"ID":"497cae3e-8c8c-46f4-985b-8c7290a3582c","Type":"ContainerStarted","Data":"dff4262efd0aa5395b7bcc2834f464b423cc9addf00802190afdc05ff5cd8d83"} Jul 14 14:31:29.100069 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.100047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" event={"ID":"c01cd591f655ced89d5c698fd66678c1","Type":"ContainerStarted","Data":"8cfbdd6343d45a5b6a32ef842de1f53f2a21696cdbea6e5ec049e1f07177b727"} Jul 14 14:31:29.100926 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.100889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:29.101279 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.101260 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jfm8m" Jul 14 14:31:29.118359 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.118307 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ldxcb" podStartSLOduration=4.708374836 podStartE2EDuration="25.118288558s" totalImagesPullingTime="20.409913722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:29.117965572 +0000 UTC m=+25.677155229" watchObservedRunningTime="2026-07-14 14:31:29.118288558 +0000 UTC m=+25.677478214" Jul 14 14:31:29.132330 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.132295 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-215.ec2.internal" podStartSLOduration=24.132280891 podStartE2EDuration="24.132280891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:29.131858751 +0000 UTC m=+25.691048405" watchObservedRunningTime="2026-07-14 14:31:29.132280891 +0000 UTC m=+25.691470549" Jul 14 14:31:29.427648 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.427609 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:29.486208 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.486150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:29.867115 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.866990 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T14:31:29.073942456Z","UUID":"0a704c2f-9bb7-4018-8bd2-a5f78227e55b","Handler":null,"Name":"","Endpoint":""} Jul 14 14:31:29.868752 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.868714 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 14:31:29.868752 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.868755 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 14:31:29.977738 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.977711 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:29.977738 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.977739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:29.978039 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:29.977824 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:29.978039 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:29.977888 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:29.978039 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:29.977946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:29.978039 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:29.978036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:30.106540 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:30.106512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:31:30.107090 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:30.107029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"99e479eb08323817fee8366f0d0b6ee593cb30645a7ad29bb4ac4e9d482747f2"} Jul 14 14:31:31.111533 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:31.111496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" event={"ID":"497cae3e-8c8c-46f4-985b-8c7290a3582c","Type":"ContainerStarted","Data":"38563fdd3bda7f8342071f1410d2cd3561eb02209897762631128a8efff9656c"} Jul 14 14:31:31.129892 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:31.129849 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hjvl5" podStartSLOduration=4.154702045 podStartE2EDuration="27.129830638s" totalImagesPullingTime="22.975128593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:31.129212317 +0000 UTC m=+27.688402000" watchObservedRunningTime="2026-07-14 14:31:31.129830638 +0000 UTC m=+27.689020294" Jul 14 14:31:31.977936 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:31.977907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:31.978113 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:31.977907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:31.978113 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:31.978031 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:31.978231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:31.977907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:31.978231 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:31.978127 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:31.978231 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:31.978195 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:33.119103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.118953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:31:33.119767 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.119468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"835e42388ba329e6e623713113010f55a7a9c415c134a7460d596e758138feba"} Jul 14 14:31:33.119767 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.119739 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:33.119954 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.119937 2562 scope.go:117] "RemoveContainer" containerID="4813492ec37a48c2ee1f8e64f25ffb3b491506bc6f0dec763e593996c13af852" Jul 14 14:31:33.121515 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.121489 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="457022c7d715ec1d035ee1a0f989515dacdca95c03aa96d2353d58fefef3f4ea" exitCode=0 Jul 14 14:31:33.121609 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.121524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"457022c7d715ec1d035ee1a0f989515dacdca95c03aa96d2353d58fefef3f4ea"} Jul 14 14:31:33.135653 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.135637 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:33.981140 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.981111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:33.981373 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:33.981207 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:33.981623 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.981602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:33.981734 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:33.981713 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:33.981807 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:33.981771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:33.981863 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:33.981850 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:34.127870 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.127842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:31:34.128397 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.128176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" event={"ID":"44e66830-01ad-4755-bf81-9de5e6c504b0","Type":"ContainerStarted","Data":"ff36c193fe37cb5482a9c6795dcd6f7ba23894d319132341002708c6070f81c9"} Jul 14 14:31:34.128541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.128525 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:34.128623 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.128608 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:34.143282 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.143257 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:31:34.153611 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.153572 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" podStartSLOduration=9.480330833 podStartE2EDuration="30.15356063s" totalImagesPullingTime="20.673229797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:34.153357429 +0000 UTC m=+30.712547104" watchObservedRunningTime="2026-07-14 14:31:34.15356063 +0000 UTC m=+30.712750283" Jul 14 14:31:34.659080 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.658929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd9nk"] Jul 14 14:31:34.659228 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.659178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:34.659320 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:34.659301 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:34.662836 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.662813 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bqzl7"] Jul 14 14:31:34.662939 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.662886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:34.663066 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:34.662966 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:34.663488 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.663467 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5d8w"] Jul 14 14:31:34.663561 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:34.663549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:34.663661 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:34.663642 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:35.132255 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:35.132226 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="34651296d7833f0db1e010e55f1d45c28fa5d83100603c2449a52cce244aaefb" exitCode=0 Jul 14 14:31:35.132744 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:35.132316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"34651296d7833f0db1e010e55f1d45c28fa5d83100603c2449a52cce244aaefb"} Jul 14 14:31:35.258320 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:35.258291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.310637 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:35.310596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:35.980872 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:35.980842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:35.981020 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:35.980976 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:36.977817 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:36.977787 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:36.978158 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:36.977889 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:36.978158 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:36.977938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:36.978158 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:36.978017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:37.139163 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.139089 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="44e113540330c4611e5018e67c1cd7d9b973c81f779509a79162d90ecf16aa44" exitCode=0 Jul 14 14:31:37.139163 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.139123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"44e113540330c4611e5018e67c1cd7d9b973c81f779509a79162d90ecf16aa44"} Jul 14 14:31:37.542810 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.542629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:37.542810 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.542773 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:37.543023 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.542868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret podName:4e86cea4-03bd-4f27-88ca-b9da41cb10a7 nodeName:}" failed. No retries permitted until 2026-07-14 14:32:09.542853793 +0000 UTC m=+66.102043427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret") pod "global-pull-secret-syncer-k5d8w" (UID: "4e86cea4-03bd-4f27-88ca-b9da41cb10a7") : object "kube-system"/"original-pull-secret" not registered Jul 14 14:31:37.643675 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.643641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:37.643871 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.643816 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:37.643934 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.643888 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs podName:ccfd69e9-9446-4bd0-af9c-ebd69f74f876 nodeName:}" failed. No retries permitted until 2026-07-14 14:32:09.643867041 +0000 UTC m=+66.203056674 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs") pod "network-metrics-daemon-bd9nk" (UID: "ccfd69e9-9446-4bd0-af9c-ebd69f74f876") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 14:31:37.744956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.744925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:37.745113 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.745049 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 14:31:37.745113 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.745067 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 14:31:37.745113 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.745075 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jzpc9 for pod openshift-network-diagnostics/network-check-target-bqzl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:37.745254 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.745123 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9 podName:f822c605-0d8a-43dc-bbff-38af6415107e nodeName:}" failed. No retries permitted until 2026-07-14 14:32:09.745110434 +0000 UTC m=+66.304300068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jzpc9" (UniqueName: "kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9") pod "network-check-target-bqzl7" (UID: "f822c605-0d8a-43dc-bbff-38af6415107e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 14:31:37.977586 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:37.977557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:37.977767 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:37.977664 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bqzl7" podUID="f822c605-0d8a-43dc-bbff-38af6415107e" Jul 14 14:31:38.977323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:38.977276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:38.977819 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:38.977397 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd9nk" podUID="ccfd69e9-9446-4bd0-af9c-ebd69f74f876" Jul 14 14:31:38.977819 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:38.977459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:38.977819 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:38.977550 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5d8w" podUID="4e86cea4-03bd-4f27-88ca-b9da41cb10a7" Jul 14 14:31:39.548887 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.548840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.606982 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.606881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.819360 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.819331 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-215.ec2.internal" event="NodeReady" Jul 14 14:31:39.819516 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.819460 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 14:31:39.862796 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.862732 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nvrf4"] Jul 14 14:31:39.882923 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.882894 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h458h"] Jul 14 14:31:39.883172 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.883017 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:39.885602 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.885577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 14:31:39.885752 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.885605 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 14:31:39.885752 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.885634 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x4st5\"" Jul 14 14:31:39.899119 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.899098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nvrf4"] Jul 14 14:31:39.899235 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.899135 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h458h"] Jul 14 14:31:39.899311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.899251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:39.901406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.901379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 14:31:39.901485 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.901456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chg99\"" Jul 14 14:31:39.901792 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.901763 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 14:31:39.901792 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.901769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 14:31:39.901947 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.901787 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 14:31:39.963531 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.963502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j9whj"] Jul 14 14:31:39.985642 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.985612 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9whj"] Jul 14 14:31:39.986082 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.985774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:39.986082 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.985775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:31:39.987672 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.987649 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:39.988238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988219 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 14:31:39.988438 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988420 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fdbdg\"" Jul 14 14:31:39.988493 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988479 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 14:31:39.988647 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988633 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:31:39.988782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988732 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqsw5\"" Jul 14 14:31:39.988782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988634 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 14:31:39.988912 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:39.988845 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:31:40.062220 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6bbe485-4b58-47ba-a51b-5561289c4a8b-tmp-dir\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-data-volume\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9wjp\" (UniqueName: \"kubernetes.io/projected/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-api-access-v9wjp\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6bbe485-4b58-47ba-a51b-5561289c4a8b-config-volume\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5r9r\" (UniqueName: \"kubernetes.io/projected/f6bbe485-4b58-47ba-a51b-5561289c4a8b-kube-api-access-z5r9r\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-crio-socket\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.062389 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.062658 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.062658 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.062506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6bbe485-4b58-47ba-a51b-5561289c4a8b-tmp-dir\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.163311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/563b2180-4213-400c-90fc-4fb76cf71be8-cert\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.163311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8b8v\" (UniqueName: \"kubernetes.io/projected/563b2180-4213-400c-90fc-4fb76cf71be8-kube-api-access-k8b8v\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.163583 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-data-volume\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163583 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9wjp\" (UniqueName: \"kubernetes.io/projected/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-api-access-v9wjp\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163583 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6bbe485-4b58-47ba-a51b-5561289c4a8b-config-volume\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.163583 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5r9r\" (UniqueName: \"kubernetes.io/projected/f6bbe485-4b58-47ba-a51b-5561289c4a8b-kube-api-access-z5r9r\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.163773 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6bbe485-4b58-47ba-a51b-5561289c4a8b-tmp-dir\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.163773 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163651 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-data-volume\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163773 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-crio-socket\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163773 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163798 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163848 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:40.663832234 +0000 UTC m=+37.223021885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163863 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-crio-socket\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163873 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:40.163913 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.163880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.164116 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163940 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:40.663923882 +0000 UTC m=+37.223113521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : configmap "kube-rbac-proxy" not found Jul 14 14:31:40.164116 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163943 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:40.164116 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.163978 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:40.663969973 +0000 UTC m=+37.223159605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:40.164116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.164019 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6bbe485-4b58-47ba-a51b-5561289c4a8b-config-volume\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.174134 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.174112 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5r9r\" (UniqueName: \"kubernetes.io/projected/f6bbe485-4b58-47ba-a51b-5561289c4a8b-kube-api-access-z5r9r\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.174262 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.174150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9wjp\" (UniqueName: \"kubernetes.io/projected/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-api-access-v9wjp\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.264902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.264869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/563b2180-4213-400c-90fc-4fb76cf71be8-cert\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.265072 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.264910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8b8v\" (UniqueName: \"kubernetes.io/projected/563b2180-4213-400c-90fc-4fb76cf71be8-kube-api-access-k8b8v\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.267815 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.267789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/563b2180-4213-400c-90fc-4fb76cf71be8-cert\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.282510 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.282471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8b8v\" (UniqueName: \"kubernetes.io/projected/563b2180-4213-400c-90fc-4fb76cf71be8-kube-api-access-k8b8v\") pod \"ingress-canary-j9whj\" (UID: \"563b2180-4213-400c-90fc-4fb76cf71be8\") " pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.298265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.298241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9whj" Jul 14 14:31:40.504872 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.504843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9whj"] Jul 14 14:31:40.668285 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.668251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:40.668285 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.668289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.668315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668411 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668441 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668444 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:41.668453723 +0000 UTC m=+38.227643371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : configmap "kube-rbac-proxy" not found Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668508 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:41.668480936 +0000 UTC m=+38.227670572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:40.668529 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:40.668524 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:41.66851503 +0000 UTC m=+38.227704664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:40.977449 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.977414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:31:40.977612 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.977460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:31:40.979970 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.979950 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:31:40.980596 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.980578 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:31:40.980596 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:40.980588 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shzjn\"" Jul 14 14:31:41.103886 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:41.103860 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pv6nq_710ff849-bbba-4bee-bc62-240b56c9f52d/dns-node-resolver/0.log" Jul 14 14:31:41.676821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:41.676779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:41.676999 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:41.676831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:41.676999 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:41.676879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:41.676999 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.676931 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:41.676999 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.676935 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:41.676999 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.676990 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:41.677234 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.676995 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:43.676979334 +0000 UTC m=+40.236168967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:41.677234 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.677061 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:43.677042293 +0000 UTC m=+40.236231930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : configmap "kube-rbac-proxy" not found Jul 14 14:31:41.677234 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:41.677078 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:43.677068621 +0000 UTC m=+40.236258257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:41.703315 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:41.703280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5fdl_5686109b-f12b-42a6-ae2e-dce0ca3129c6/node-ca/0.log" Jul 14 14:31:42.033305 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:42.033069 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563b2180_4213_400c_90fc_4fb76cf71be8.slice/crio-5c1c682932f524c7718847a5d69607ada50ab47c861f81a59a66e688bae3a5fd WatchSource:0}: Error finding container 5c1c682932f524c7718847a5d69607ada50ab47c861f81a59a66e688bae3a5fd: Status 404 returned error can't find the container with id 5c1c682932f524c7718847a5d69607ada50ab47c861f81a59a66e688bae3a5fd Jul 14 14:31:42.152714 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:42.152666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9whj" event={"ID":"563b2180-4213-400c-90fc-4fb76cf71be8","Type":"ContainerStarted","Data":"5c1c682932f524c7718847a5d69607ada50ab47c861f81a59a66e688bae3a5fd"} Jul 14 14:31:43.158238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:43.158179 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="1d5537b53c975e96a97a1c485f84ad7b8dcf27acd96c6208a53b3eb6e1db2c78" exitCode=0 Jul 14 14:31:43.158704 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:43.158258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"1d5537b53c975e96a97a1c485f84ad7b8dcf27acd96c6208a53b3eb6e1db2c78"} Jul 14 14:31:43.691904 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:43.691869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:43.692078 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:43.691913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:43.692078 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.691992 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:43.692078 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:43.691999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:43.692078 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.692059 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:47.692040046 +0000 UTC m=+44.251229684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : configmap "kube-rbac-proxy" not found Jul 14 14:31:43.692265 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.692088 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:43.692265 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.692106 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:43.692265 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.692124 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:47.692113955 +0000 UTC m=+44.251303591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:43.692265 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:43.692172 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:47.692152316 +0000 UTC m=+44.251341962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:44.164655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.164624 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8ae5192-2faa-4dd3-9975-7b06cf8fc06d" containerID="c0c321def16a3757d728875be08efc80a4cdefe9009c74f3ddb50f15334c5a4c" exitCode=0 Jul 14 14:31:44.164655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.164664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerDied","Data":"c0c321def16a3757d728875be08efc80a4cdefe9009c74f3ddb50f15334c5a4c"} Jul 14 14:31:44.253957 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.253925 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-2s6bp"] Jul 14 14:31:44.275014 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.274985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-2s6bp"] Jul 14 14:31:44.275158 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.275097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.277673 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.277354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4pnx2\"" Jul 14 14:31:44.277673 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.277366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:44.277673 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.277458 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:44.277673 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.277464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 14:31:44.277908 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.277884 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 14:31:44.282321 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.282278 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 14:31:44.308412 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.308383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-serving-cert\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.308628 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.308602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-config\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.308766 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.308640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-trusted-ca\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.308766 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.308732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2jpr\" (UniqueName: \"kubernetes.io/projected/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-kube-api-access-w2jpr\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.363190 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.363155 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml"] Jul 14 14:31:44.380709 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.380664 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n"] Jul 14 14:31:44.380830 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.380790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.384214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.384189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:44.384421 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.384405 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 14:31:44.384524 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.384423 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m6dw9\"" Jul 14 14:31:44.384585 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.384561 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:44.408010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.407984 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl"] Jul 14 14:31:44.408139 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.408120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.409184 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-serving-cert\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.409293 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqld4\" (UniqueName: \"kubernetes.io/projected/b92aec95-ce23-42fc-a271-d0367a27fcbd-kube-api-access-vqld4\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.409293 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hg8\" (UniqueName: \"kubernetes.io/projected/a0debee4-dd21-4be2-b9e8-b26e3b741a41-kube-api-access-t9hg8\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.409293 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.409466 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0debee4-dd21-4be2-b9e8-b26e3b741a41-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.409466 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-config\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.409466 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-trusted-ca\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.409466 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2jpr\" (UniqueName: \"kubernetes.io/projected/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-kube-api-access-w2jpr\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.409634 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.409483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0debee4-dd21-4be2-b9e8-b26e3b741a41-config\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.410197 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.410172 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-config\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.410746 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.410726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-trusted-ca\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.411274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.410960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:44.411274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.411009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-72h7q\"" Jul 14 14:31:44.411274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.411014 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 14:31:44.411274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.410960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:44.411274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.411130 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 14:31:44.413581 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.413560 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-serving-cert\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.417843 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.417794 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2jpr\" (UniqueName: \"kubernetes.io/projected/b8c96acb-77ea-4835-91bc-7de45c5d6d0f-kube-api-access-w2jpr\") pod \"console-operator-7866497494-2s6bp\" (UID: \"b8c96acb-77ea-4835-91bc-7de45c5d6d0f\") " pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.430366 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.430343 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml"] Jul 14 14:31:44.430467 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.430383 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl"] Jul 14 14:31:44.430467 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.430407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n"] Jul 14 14:31:44.430575 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.430485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.433036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.432753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 14:31:44.433036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.432810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p4n49\"" Jul 14 14:31:44.433036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.432881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:44.433036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.432881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 14:31:44.433277 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.433119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 14:31:44.510289 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqld4\" (UniqueName: \"kubernetes.io/projected/b92aec95-ce23-42fc-a271-d0367a27fcbd-kube-api-access-vqld4\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.510350 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2898\" (UniqueName: \"kubernetes.io/projected/da93c763-cb9f-4e2c-a223-e8388c036dd5-kube-api-access-h2898\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.510388 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hg8\" (UniqueName: \"kubernetes.io/projected/a0debee4-dd21-4be2-b9e8-b26e3b741a41-kube-api-access-t9hg8\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.510443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.510443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510438 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da93c763-cb9f-4e2c-a223-e8388c036dd5-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.510539 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0debee4-dd21-4be2-b9e8-b26e3b741a41-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.510539 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:44.510501 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:31:44.510631 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:44.510569 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls podName:b92aec95-ce23-42fc-a271-d0367a27fcbd nodeName:}" failed. No retries permitted until 2026-07-14 14:31:45.010540638 +0000 UTC m=+41.569730270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls") pod "cluster-samples-operator-65db858894-kcsml" (UID: "b92aec95-ce23-42fc-a271-d0367a27fcbd") : secret "samples-operator-tls" not found Jul 14 14:31:44.510631 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0debee4-dd21-4be2-b9e8-b26e3b741a41-config\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.510771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.510638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da93c763-cb9f-4e2c-a223-e8388c036dd5-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.511096 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.511076 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a0debee4-dd21-4be2-b9e8-b26e3b741a41-config\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.512800 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.512777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a0debee4-dd21-4be2-b9e8-b26e3b741a41-serving-cert\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.519566 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.519515 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqld4\" (UniqueName: \"kubernetes.io/projected/b92aec95-ce23-42fc-a271-d0367a27fcbd-kube-api-access-vqld4\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:44.519649 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.519573 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hg8\" (UniqueName: \"kubernetes.io/projected/a0debee4-dd21-4be2-b9e8-b26e3b741a41-kube-api-access-t9hg8\") pod \"service-ca-operator-7695fc6c8c-q948n\" (UID: \"a0debee4-dd21-4be2-b9e8-b26e3b741a41\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.586990 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.586850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:44.611314 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.611291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da93c763-cb9f-4e2c-a223-e8388c036dd5-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.611391 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.611357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da93c763-cb9f-4e2c-a223-e8388c036dd5-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.611425 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.611394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2898\" (UniqueName: \"kubernetes.io/projected/da93c763-cb9f-4e2c-a223-e8388c036dd5-kube-api-access-h2898\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.611774 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.611754 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da93c763-cb9f-4e2c-a223-e8388c036dd5-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.613819 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.613801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da93c763-cb9f-4e2c-a223-e8388c036dd5-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.621743 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.621716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2898\" (UniqueName: \"kubernetes.io/projected/da93c763-cb9f-4e2c-a223-e8388c036dd5-kube-api-access-h2898\") pod \"kube-storage-version-migrator-operator-799cb7f958-lm4dl\" (UID: \"da93c763-cb9f-4e2c-a223-e8388c036dd5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.729334 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.729298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" Jul 14 14:31:44.740970 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.740947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" Jul 14 14:31:44.778590 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.778488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-2s6bp"] Jul 14 14:31:44.783552 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:44.783508 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c96acb_77ea_4835_91bc_7de45c5d6d0f.slice/crio-6426172ffc5069f703eb5bda07a5f691e812cd7dc3ec06758c26820209fb1da2 WatchSource:0}: Error finding container 6426172ffc5069f703eb5bda07a5f691e812cd7dc3ec06758c26820209fb1da2: Status 404 returned error can't find the container with id 6426172ffc5069f703eb5bda07a5f691e812cd7dc3ec06758c26820209fb1da2 Jul 14 14:31:44.881230 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.881200 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n"] Jul 14 14:31:44.884323 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:44.884288 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0debee4_dd21_4be2_b9e8_b26e3b741a41.slice/crio-73d211468d5c96c8f47866a4728e8429756c50173e61f6205798211249cdbda5 WatchSource:0}: Error finding container 73d211468d5c96c8f47866a4728e8429756c50173e61f6205798211249cdbda5: Status 404 returned error can't find the container with id 73d211468d5c96c8f47866a4728e8429756c50173e61f6205798211249cdbda5 Jul 14 14:31:44.890530 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:44.890500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl"] Jul 14 14:31:44.893537 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:44.893513 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda93c763_cb9f_4e2c_a223_e8388c036dd5.slice/crio-44698b39b562c68c305a0035e3508522c40f677d8bac95fe162c6a650eed445d WatchSource:0}: Error finding container 44698b39b562c68c305a0035e3508522c40f677d8bac95fe162c6a650eed445d: Status 404 returned error can't find the container with id 44698b39b562c68c305a0035e3508522c40f677d8bac95fe162c6a650eed445d Jul 14 14:31:45.013842 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.013814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:45.014009 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:45.013974 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:31:45.014053 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:45.014043 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls podName:b92aec95-ce23-42fc-a271-d0367a27fcbd nodeName:}" failed. No retries permitted until 2026-07-14 14:31:46.014021871 +0000 UTC m=+42.573211524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls") pod "cluster-samples-operator-65db858894-kcsml" (UID: "b92aec95-ce23-42fc-a271-d0367a27fcbd") : secret "samples-operator-tls" not found Jul 14 14:31:45.170709 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.170660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" event={"ID":"a8ae5192-2faa-4dd3-9975-7b06cf8fc06d","Type":"ContainerStarted","Data":"fd211faa425aaf40be43cb9348f0beb4ad4ac1923737a2e83f568cf50fc707e4"} Jul 14 14:31:45.172102 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.172082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9whj" event={"ID":"563b2180-4213-400c-90fc-4fb76cf71be8","Type":"ContainerStarted","Data":"107e69b41d98f411ed687905b9a117fac1df3d0c4c630de98856ba71ebce42bf"} Jul 14 14:31:45.173158 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.173138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" event={"ID":"da93c763-cb9f-4e2c-a223-e8388c036dd5","Type":"ContainerStarted","Data":"44698b39b562c68c305a0035e3508522c40f677d8bac95fe162c6a650eed445d"} Jul 14 14:31:45.174192 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.174170 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" event={"ID":"a0debee4-dd21-4be2-b9e8-b26e3b741a41","Type":"ContainerStarted","Data":"73d211468d5c96c8f47866a4728e8429756c50173e61f6205798211249cdbda5"} Jul 14 14:31:45.175058 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.175041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2s6bp" event={"ID":"b8c96acb-77ea-4835-91bc-7de45c5d6d0f","Type":"ContainerStarted","Data":"6426172ffc5069f703eb5bda07a5f691e812cd7dc3ec06758c26820209fb1da2"} Jul 14 14:31:45.193907 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.193871 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppg4l" podStartSLOduration=8.252499597 podStartE2EDuration="41.193858427s" totalImagesPullingTime="32.94135883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:45.192853422 +0000 UTC m=+41.752043076" watchObservedRunningTime="2026-07-14 14:31:45.193858427 +0000 UTC m=+41.753048084" Jul 14 14:31:45.208909 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.208874 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j9whj" podStartSLOduration=3.582782917 podStartE2EDuration="6.208862489s" totalImagesPullingTime="2.626079572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:45.20801304 +0000 UTC m=+41.767202707" watchObservedRunningTime="2026-07-14 14:31:45.208862489 +0000 UTC m=+41.768052143" Jul 14 14:31:45.284284 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.284197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:45.386486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:45.386277 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:46.020838 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:46.020790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:46.021072 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:46.021057 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:31:46.021143 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:46.021127 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls podName:b92aec95-ce23-42fc-a271-d0367a27fcbd nodeName:}" failed. No retries permitted until 2026-07-14 14:31:48.021105873 +0000 UTC m=+44.580295529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls") pod "cluster-samples-operator-65db858894-kcsml" (UID: "b92aec95-ce23-42fc-a271-d0367a27fcbd") : secret "samples-operator-tls" not found Jul 14 14:31:46.092554 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:46.092518 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:46.192708 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:46.192620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:46.570350 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:46.570307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:47.464790 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:47.464756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:47.730145 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:47.730117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:47.730292 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:47.730152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:47.730292 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:47.730180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:47.730292 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730245 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 14:31:47.730292 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730255 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:47.730408 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730254 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:47.730408 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730304 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:55.730288752 +0000 UTC m=+52.289478385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : configmap "kube-rbac-proxy" not found Jul 14 14:31:47.730408 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:31:55.730326391 +0000 UTC m=+52.289516028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:47.730408 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:47.730356 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:31:55.730347651 +0000 UTC m=+52.289537286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:48.032408 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:48.032313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:48.032576 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:48.032473 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:31:48.032576 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:48.032540 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls podName:b92aec95-ce23-42fc-a271-d0367a27fcbd nodeName:}" failed. No retries permitted until 2026-07-14 14:31:52.032523488 +0000 UTC m=+48.591713120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls") pod "cluster-samples-operator-65db858894-kcsml" (UID: "b92aec95-ce23-42fc-a271-d0367a27fcbd") : secret "samples-operator-tls" not found Jul 14 14:31:49.186737 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.186631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" event={"ID":"da93c763-cb9f-4e2c-a223-e8388c036dd5","Type":"ContainerStarted","Data":"8bc014681bfe2a75e1103d2861054bb9ceb4f5f00ed012fb58d0ab97c6ba3f2f"} Jul 14 14:31:49.188277 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.188245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" event={"ID":"a0debee4-dd21-4be2-b9e8-b26e3b741a41","Type":"ContainerStarted","Data":"4bd8040b4a9b8777235f5ea918b81acb9fc0f96f8548cf9936460777166b055a"} Jul 14 14:31:49.189883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.189858 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/0.log" Jul 14 14:31:49.189977 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.189899 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" containerID="b8c5df71c5d71d59bd2ecce575b7fc78d038eb6c1f4c17722710d0452dff2d36" exitCode=255 Jul 14 14:31:49.189977 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.189935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2s6bp" event={"ID":"b8c96acb-77ea-4835-91bc-7de45c5d6d0f","Type":"ContainerDied","Data":"b8c5df71c5d71d59bd2ecce575b7fc78d038eb6c1f4c17722710d0452dff2d36"} Jul 14 14:31:49.190173 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.190157 2562 scope.go:117] "RemoveContainer" containerID="b8c5df71c5d71d59bd2ecce575b7fc78d038eb6c1f4c17722710d0452dff2d36" Jul 14 14:31:49.202597 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.202553 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" podStartSLOduration=1.346642123 podStartE2EDuration="5.202540465s" totalImagesPullingTime="3.855898342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:49.20169408 +0000 UTC m=+45.760883750" watchObservedRunningTime="2026-07-14 14:31:49.202540465 +0000 UTC m=+45.761730097" Jul 14 14:31:49.234564 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:49.234518 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" podStartSLOduration=1.3738812249999999 podStartE2EDuration="5.234499317s" totalImagesPullingTime="3.860618092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:49.234336789 +0000 UTC m=+45.793526445" watchObservedRunningTime="2026-07-14 14:31:49.234499317 +0000 UTC m=+45.793688976" Jul 14 14:31:50.195235 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/1.log" Jul 14 14:31:50.195597 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195582 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/0.log" Jul 14 14:31:50.195650 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195617 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" exitCode=255 Jul 14 14:31:50.195736 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2s6bp" event={"ID":"b8c96acb-77ea-4835-91bc-7de45c5d6d0f","Type":"ContainerDied","Data":"b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8"} Jul 14 14:31:50.195802 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195768 2562 scope.go:117] "RemoveContainer" containerID="b8c5df71c5d71d59bd2ecce575b7fc78d038eb6c1f4c17722710d0452dff2d36" Jul 14 14:31:50.195979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.195959 2562 scope.go:117] "RemoveContainer" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" Jul 14 14:31:50.196132 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:50.196110 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:31:50.267870 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.267841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:50.370179 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.370139 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:50.470384 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.470307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:50.769100 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.769055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:50.825757 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:50.825720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.005950 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.005924 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z"] Jul 14 14:31:51.039030 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.038966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z"] Jul 14 14:31:51.039153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.039074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" Jul 14 14:31:51.041458 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.041435 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 14:31:51.042062 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.042044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j8fww\"" Jul 14 14:31:51.042160 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.042063 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 14:31:51.054494 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.054474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.056381 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.056354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2s4\" (UniqueName: \"kubernetes.io/projected/3132fd38-e19e-4e07-9ded-ddfd536b4125-kube-api-access-hr2s4\") pod \"migrator-7f59b54f6c-tsr2z\" (UID: \"3132fd38-e19e-4e07-9ded-ddfd536b4125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" Jul 14 14:31:51.157011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.156986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2s4\" (UniqueName: \"kubernetes.io/projected/3132fd38-e19e-4e07-9ded-ddfd536b4125-kube-api-access-hr2s4\") pod \"migrator-7f59b54f6c-tsr2z\" (UID: \"3132fd38-e19e-4e07-9ded-ddfd536b4125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" Jul 14 14:31:51.158005 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.157982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:51.165288 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.165268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2s4\" (UniqueName: \"kubernetes.io/projected/3132fd38-e19e-4e07-9ded-ddfd536b4125-kube-api-access-hr2s4\") pod \"migrator-7f59b54f6c-tsr2z\" (UID: \"3132fd38-e19e-4e07-9ded-ddfd536b4125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" Jul 14 14:31:51.200001 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.199985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/1.log" Jul 14 14:31:51.200269 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.200246 2562 scope.go:117] "RemoveContainer" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" Jul 14 14:31:51.200393 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:51.200375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:31:51.348791 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.348723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" Jul 14 14:31:51.491182 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:51.489386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z"] Jul 14 14:31:51.493160 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:31:51.493134 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3132fd38_e19e_4e07_9ded_ddfd536b4125.slice/crio-7a48eb719df9d4e0523a77846464d2919e44227ab1ae2dbc47ee802bc08872d0 WatchSource:0}: Error finding container 7a48eb719df9d4e0523a77846464d2919e44227ab1ae2dbc47ee802bc08872d0: Status 404 returned error can't find the container with id 7a48eb719df9d4e0523a77846464d2919e44227ab1ae2dbc47ee802bc08872d0 Jul 14 14:31:52.064149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:52.064114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:31:52.064342 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:52.064308 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 14:31:52.064412 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:52.064405 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls podName:b92aec95-ce23-42fc-a271-d0367a27fcbd nodeName:}" failed. No retries permitted until 2026-07-14 14:32:00.064382035 +0000 UTC m=+56.623571684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls") pod "cluster-samples-operator-65db858894-kcsml" (UID: "b92aec95-ce23-42fc-a271-d0367a27fcbd") : secret "samples-operator-tls" not found Jul 14 14:31:52.204106 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:52.204035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" event={"ID":"3132fd38-e19e-4e07-9ded-ddfd536b4125","Type":"ContainerStarted","Data":"7a48eb719df9d4e0523a77846464d2919e44227ab1ae2dbc47ee802bc08872d0"} Jul 14 14:31:52.679536 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:52.679509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:52.778995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:52.778960 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:52.880239 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:52.880215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:53.208162 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:53.208083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" event={"ID":"3132fd38-e19e-4e07-9ded-ddfd536b4125","Type":"ContainerStarted","Data":"8903487ca2169e85098bde08c7f2655ac268f555896b88ce2b7d05a53d09b21a"} Jul 14 14:31:53.208162 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:53.208131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" event={"ID":"3132fd38-e19e-4e07-9ded-ddfd536b4125","Type":"ContainerStarted","Data":"c091b9ecb5d43f16ff6598c611ff17081e3c12d775f6853f0e2742d4be10d0dd"} Jul 14 14:31:53.234630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:53.234579 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-tsr2z" podStartSLOduration=1.937809417 podStartE2EDuration="3.234564803s" totalImagesPullingTime="1.296755386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:31:53.232709846 +0000 UTC m=+49.791899517" watchObservedRunningTime="2026-07-14 14:31:53.234564803 +0000 UTC m=+49.793754458" Jul 14 14:31:53.590821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:53.590786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:54.587739 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:54.587703 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:54.588116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:54.587761 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:31:54.588116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:54.588081 2562 scope.go:117] "RemoveContainer" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" Jul 14 14:31:54.588232 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:54.588215 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:31:55.794516 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:55.794482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:55.794525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:55.794621 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:55.794692 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls podName:f6bbe485-4b58-47ba-a51b-5561289c4a8b nodeName:}" failed. No retries permitted until 2026-07-14 14:32:11.794663839 +0000 UTC m=+68.353853471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls") pod "dns-default-nvrf4" (UID: "f6bbe485-4b58-47ba-a51b-5561289c4a8b") : secret "dns-default-metrics-tls" not found Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:55.794700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:55.794883 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 14:31:55.795011 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:31:55.794937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls podName:41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0 nodeName:}" failed. No retries permitted until 2026-07-14 14:32:11.794923742 +0000 UTC m=+68.354113374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h458h" (UID: "41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0") : secret "insights-runtime-extractor-tls" not found Jul 14 14:31:55.795229 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:55.795042 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:31:57.704748 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:57.704717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:57.992807 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:57.992766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.095342 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.095312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.200061 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.200038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.299735 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.299643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.398690 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.398657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.500246 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.500205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.661978 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.661886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:58.781234 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:58.781199 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:31:59.562503 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:31:59.562472 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:00.124598 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.124571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:32:00.127061 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.127040 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92aec95-ce23-42fc-a271-d0367a27fcbd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-kcsml\" (UID: \"b92aec95-ce23-42fc-a271-d0367a27fcbd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:32:00.159722 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.159670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:00.292157 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.292123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" Jul 14 14:32:00.414140 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.414070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml"] Jul 14 14:32:00.549994 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.549963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:00.652090 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.652061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:00.772497 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.772468 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:00.963520 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:00.963487 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:01.234267 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:01.234241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" event={"ID":"b92aec95-ce23-42fc-a271-d0367a27fcbd","Type":"ContainerStarted","Data":"75da8a34b276a93e45acdffab2b05c94ec73b3ee94ea7a3b83865bdaf821ffbc"} Jul 14 14:32:01.579639 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:01.579539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:01.755303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:01.755269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:01.887520 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:01.887442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:02.270493 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:02.270458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:02.372768 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:02.372738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:02.612664 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:02.612560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:02.707906 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:02.707878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:02.763836 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:02.763800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:03.965549 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:03.965465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:04.225566 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:04.225537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:04.246222 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:04.246198 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" event={"ID":"b92aec95-ce23-42fc-a271-d0367a27fcbd","Type":"ContainerStarted","Data":"fcf2928fac0eb3b9f6b6736a5c88c42a550b301d2efe99e05cd17c485c26a66d"} Jul 14 14:32:04.246365 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:04.246241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" event={"ID":"b92aec95-ce23-42fc-a271-d0367a27fcbd","Type":"ContainerStarted","Data":"119fe5aaee89fa7cf65f9f46786ba3327b5c872e4b831002bcbe4f6c2da20803"} Jul 14 14:32:04.262922 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:04.262876 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-kcsml" podStartSLOduration=17.092784341 podStartE2EDuration="20.262862762s" totalImagesPullingTime="3.170078421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:04.261908549 +0000 UTC m=+60.821098204" watchObservedRunningTime="2026-07-14 14:32:04.262862762 +0000 UTC m=+60.822052416" Jul 14 14:32:04.363393 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:04.363356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:05.227724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:05.227666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:05.283359 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:05.283320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:05.605395 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:05.605298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:05.963724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:05.963624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:06.145539 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:06.145512 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9d58s" Jul 14 14:32:06.160242 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:06.160214 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:06.362045 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:06.362018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:06.560353 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:06.560303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:06.764128 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:06.764097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:07.849937 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:07.849907 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:07.978084 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:07.978053 2562 scope.go:117] "RemoveContainer" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" Jul 14 14:32:08.161647 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.161569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:08.260555 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.260531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:32:08.260952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.260935 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/1.log" Jul 14 14:32:08.261052 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.260973 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" containerID="d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19" exitCode=255 Jul 14 14:32:08.261052 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.261031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2s6bp" event={"ID":"b8c96acb-77ea-4835-91bc-7de45c5d6d0f","Type":"ContainerDied","Data":"d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19"} Jul 14 14:32:08.261147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.261093 2562 scope.go:117] "RemoveContainer" containerID="b728d1660c6e191e9593fee8e23a9974bee13fa9a0ffcb73780c13ae93c9a5d8" Jul 14 14:32:08.261434 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.261410 2562 scope.go:117] "RemoveContainer" containerID="d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19" Jul 14 14:32:08.261624 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:32:08.261607 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:32:08.364149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.364118 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:08.560126 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.560095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:08.760705 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:08.760643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:09.266062 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.266032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:32:09.399832 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.399801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:09.505392 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.505363 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:09.598265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.598190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:32:09.600399 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.600383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 14:32:09.611557 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.611534 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e86cea4-03bd-4f27-88ca-b9da41cb10a7-original-pull-secret\") pod \"global-pull-secret-syncer-k5d8w\" (UID: \"4e86cea4-03bd-4f27-88ca-b9da41cb10a7\") " pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:32:09.698927 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.698886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:32:09.701533 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.701516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 14:32:09.711814 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.711788 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfd69e9-9446-4bd0-af9c-ebd69f74f876-metrics-certs\") pod \"network-metrics-daemon-bd9nk\" (UID: \"ccfd69e9-9446-4bd0-af9c-ebd69f74f876\") " pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:32:09.789349 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.789306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5d8w" Jul 14 14:32:09.799263 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.799240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:32:09.799383 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.799285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shzjn\"" Jul 14 14:32:09.802061 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.802040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 14:32:09.808143 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.808124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd9nk" Jul 14 14:32:09.812339 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.812324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 14:32:09.823051 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.823026 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpc9\" (UniqueName: \"kubernetes.io/projected/f822c605-0d8a-43dc-bbff-38af6415107e-kube-api-access-jzpc9\") pod \"network-check-target-bqzl7\" (UID: \"f822c605-0d8a-43dc-bbff-38af6415107e\") " pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:32:09.921086 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.921055 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5d8w"] Jul 14 14:32:09.925345 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:09.925310 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e86cea4_03bd_4f27_88ca_b9da41cb10a7.slice/crio-89ceeb86678698a0011f94bc7e356f9d57daf0396ac5b979cea1f6a94c7b1db4 WatchSource:0}: Error finding container 89ceeb86678698a0011f94bc7e356f9d57daf0396ac5b979cea1f6a94c7b1db4: Status 404 returned error can't find the container with id 89ceeb86678698a0011f94bc7e356f9d57daf0396ac5b979cea1f6a94c7b1db4 Jul 14 14:32:09.939222 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:09.939199 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd9nk"] Jul 14 14:32:09.941967 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:09.941946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfd69e9_9446_4bd0_af9c_ebd69f74f876.slice/crio-96106ada0f91acb519767fea485c2d16b0f0742730d53d832720214128757ed1 WatchSource:0}: Error finding container 96106ada0f91acb519767fea485c2d16b0f0742730d53d832720214128757ed1: Status 404 returned error can't find the container with id 96106ada0f91acb519767fea485c2d16b0f0742730d53d832720214128757ed1 Jul 14 14:32:10.006807 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.006779 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqsw5\"" Jul 14 14:32:10.014571 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.014532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:32:10.147024 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.146948 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bqzl7"] Jul 14 14:32:10.149936 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:10.149911 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf822c605_0d8a_43dc_bbff_38af6415107e.slice/crio-d29a516170f2ed267c8d8f2f4f627b8756b110f40c47285446d42e5f33850cea WatchSource:0}: Error finding container d29a516170f2ed267c8d8f2f4f627b8756b110f40c47285446d42e5f33850cea: Status 404 returned error can't find the container with id d29a516170f2ed267c8d8f2f4f627b8756b110f40c47285446d42e5f33850cea Jul 14 14:32:10.154266 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.154246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:10.219652 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.219607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:10.269764 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.269730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd9nk" event={"ID":"ccfd69e9-9446-4bd0-af9c-ebd69f74f876","Type":"ContainerStarted","Data":"96106ada0f91acb519767fea485c2d16b0f0742730d53d832720214128757ed1"} Jul 14 14:32:10.270894 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.270875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bqzl7" event={"ID":"f822c605-0d8a-43dc-bbff-38af6415107e","Type":"ContainerStarted","Data":"d29a516170f2ed267c8d8f2f4f627b8756b110f40c47285446d42e5f33850cea"} Jul 14 14:32:10.271902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:10.271877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5d8w" event={"ID":"4e86cea4-03bd-4f27-88ca-b9da41cb10a7","Type":"ContainerStarted","Data":"89ceeb86678698a0011f94bc7e356f9d57daf0396ac5b979cea1f6a94c7b1db4"} Jul 14 14:32:11.813630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:11.813578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:32:11.814209 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:11.813646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:32:11.816872 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:11.816841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6bbe485-4b58-47ba-a51b-5561289c4a8b-metrics-tls\") pod \"dns-default-nvrf4\" (UID: \"f6bbe485-4b58-47ba-a51b-5561289c4a8b\") " pod="openshift-dns/dns-default-nvrf4" Jul 14 14:32:11.825523 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:11.825494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h458h\" (UID: \"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0\") " pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:32:11.997855 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:11.997819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x4st5\"" Jul 14 14:32:12.004886 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.004859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nvrf4" Jul 14 14:32:12.011866 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.011840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chg99\"" Jul 14 14:32:12.020120 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.019910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h458h" Jul 14 14:32:12.180785 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.180640 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nvrf4"] Jul 14 14:32:12.203827 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.203802 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h458h"] Jul 14 14:32:12.208163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:12.208131 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b6cc3a_28a7_44d1_8a0c_e6c59c7be9b0.slice/crio-c1131850932aac259719ff262de991ef52a8c99dd7b3bc4b89490dd24461d038 WatchSource:0}: Error finding container c1131850932aac259719ff262de991ef52a8c99dd7b3bc4b89490dd24461d038: Status 404 returned error can't find the container with id c1131850932aac259719ff262de991ef52a8c99dd7b3bc4b89490dd24461d038 Jul 14 14:32:12.281318 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.281279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrf4" event={"ID":"f6bbe485-4b58-47ba-a51b-5561289c4a8b","Type":"ContainerStarted","Data":"c42d5d6710dc3a0a8e709a6f9cfbcdf0292cd2081d8f9b022754c47f8625b01d"} Jul 14 14:32:12.283217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.283187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h458h" event={"ID":"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0","Type":"ContainerStarted","Data":"c1131850932aac259719ff262de991ef52a8c99dd7b3bc4b89490dd24461d038"} Jul 14 14:32:12.947060 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:12.946969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:13.290483 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.290441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd9nk" event={"ID":"ccfd69e9-9446-4bd0-af9c-ebd69f74f876","Type":"ContainerStarted","Data":"aa743717a54be284ecf4dca028264b68effe317373ed54f059bcc05e2ecdb5b5"} Jul 14 14:32:13.290672 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.290511 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd9nk" event={"ID":"ccfd69e9-9446-4bd0-af9c-ebd69f74f876","Type":"ContainerStarted","Data":"3ed45cab32124f2e1148243402ea13c0bde2053f26973d5aefaf9f5195360039"} Jul 14 14:32:13.308416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.308362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bd9nk" podStartSLOduration=66.609086088 podStartE2EDuration="1m9.308341822s" totalImagesPullingTime="2.699255734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:13.306804223 +0000 UTC m=+69.865993879" watchObservedRunningTime="2026-07-14 14:32:13.308341822 +0000 UTC m=+69.867531480" Jul 14 14:32:13.451060 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.451025 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8"] Jul 14 14:32:13.453038 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.453002 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.456083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.456054 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 14:32:13.456083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.456079 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 14:32:13.456368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.456347 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 14:32:13.456583 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.456567 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 14:32:13.456865 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.456844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-46sk4\"" Jul 14 14:32:13.466371 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.466343 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8"] Jul 14 14:32:13.530368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.530333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf2efce-2a36-4615-9946-4182f77575cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.530562 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.530388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmncf\" (UniqueName: \"kubernetes.io/projected/6bf2efce-2a36-4615-9946-4182f77575cf-kube-api-access-gmncf\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.632001 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.631902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf2efce-2a36-4615-9946-4182f77575cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.632001 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.631966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmncf\" (UniqueName: \"kubernetes.io/projected/6bf2efce-2a36-4615-9946-4182f77575cf-kube-api-access-gmncf\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.635220 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.635169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf2efce-2a36-4615-9946-4182f77575cf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.643540 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.643515 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76d4ddd784-gvblm"] Jul 14 14:32:13.646817 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.646673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.651265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.650622 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 14:32:13.651265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.650645 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 14:32:13.651265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.650705 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 14:32:13.651265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.650628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9z97\"" Jul 14 14:32:13.657956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.657771 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 14:32:13.672657 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.672633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmncf\" (UniqueName: \"kubernetes.io/projected/6bf2efce-2a36-4615-9946-4182f77575cf-kube-api-access-gmncf\") pod \"managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8\" (UID: \"6bf2efce-2a36-4615-9946-4182f77575cf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.675615 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.675592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d4ddd784-gvblm"] Jul 14 14:32:13.733452 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d907a407-6913-474a-bbfd-f253cbc90328-ca-trust-extracted\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733600 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-bound-sa-token\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733600 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwdf\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-kube-api-access-kgwdf\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733600 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-trusted-ca\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733600 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-installation-pull-secrets\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733846 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-registry-certificates\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733846 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-image-registry-private-configuration\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.733846 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.733703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-registry-tls\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.773948 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.773923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" Jul 14 14:32:13.834527 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-registry-tls\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d907a407-6913-474a-bbfd-f253cbc90328-ca-trust-extracted\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-bound-sa-token\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwdf\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-kube-api-access-kgwdf\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-trusted-ca\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-installation-pull-secrets\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834935 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-registry-certificates\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.834935 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.834744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-image-registry-private-configuration\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.835045 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.835005 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d907a407-6913-474a-bbfd-f253cbc90328-ca-trust-extracted\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.835649 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.835623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-trusted-ca\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.835765 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.835674 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d907a407-6913-474a-bbfd-f253cbc90328-registry-certificates\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.837369 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.837317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-registry-tls\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.837470 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.837446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-installation-pull-secrets\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.837544 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.837529 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d907a407-6913-474a-bbfd-f253cbc90328-image-registry-private-configuration\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.843391 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.843364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwdf\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-kube-api-access-kgwdf\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.843391 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.843382 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d907a407-6913-474a-bbfd-f253cbc90328-bound-sa-token\") pod \"image-registry-76d4ddd784-gvblm\" (UID: \"d907a407-6913-474a-bbfd-f253cbc90328\") " pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:13.884246 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.884166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:13.961915 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:13.961884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:14.587194 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:14.587152 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:32:14.587369 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:14.587224 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:32:14.587601 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:14.587582 2562 scope.go:117] "RemoveContainer" containerID="d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19" Jul 14 14:32:14.587805 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:32:14.587782 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:32:14.929296 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:14.929211 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:16.876190 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:16.876157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d4ddd784-gvblm"] Jul 14 14:32:16.883082 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:16.883050 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd907a407_6913_474a_bbfd_f253cbc90328.slice/crio-2dc4311e423bfd66b80eaf583c61f42539897967f68bc7e57e9c434ec768f3a1 WatchSource:0}: Error finding container 2dc4311e423bfd66b80eaf583c61f42539897967f68bc7e57e9c434ec768f3a1: Status 404 returned error can't find the container with id 2dc4311e423bfd66b80eaf583c61f42539897967f68bc7e57e9c434ec768f3a1 Jul 14 14:32:16.891230 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:16.891205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8"] Jul 14 14:32:16.896178 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:16.896150 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf2efce_2a36_4615_9946_4182f77575cf.slice/crio-c03994c6894bbb63f0f2ae10dafa9202272f9fe397222ff781037f83bd091072 WatchSource:0}: Error finding container c03994c6894bbb63f0f2ae10dafa9202272f9fe397222ff781037f83bd091072: Status 404 returned error can't find the container with id c03994c6894bbb63f0f2ae10dafa9202272f9fe397222ff781037f83bd091072 Jul 14 14:32:17.309734 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.309671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bqzl7" event={"ID":"f822c605-0d8a-43dc-bbff-38af6415107e","Type":"ContainerStarted","Data":"4271f947205feba5ae5db9e49a4b08b2e3291fe096bed349e76a0ce159bbc980"} Jul 14 14:32:17.309919 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.309784 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:32:17.312027 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.311562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5d8w" event={"ID":"4e86cea4-03bd-4f27-88ca-b9da41cb10a7","Type":"ContainerStarted","Data":"1ab53aebc6d6353762da2416ed64c335ed1c2ba366241e12301746f45d07a755"} Jul 14 14:32:17.314209 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.314178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrf4" event={"ID":"f6bbe485-4b58-47ba-a51b-5561289c4a8b","Type":"ContainerStarted","Data":"81ddcaf0456c97bf20e0b95cf373c3a8729f81c81b97a60d018a679d8a82222c"} Jul 14 14:32:17.314323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.314240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrf4" event={"ID":"f6bbe485-4b58-47ba-a51b-5561289c4a8b","Type":"ContainerStarted","Data":"7b388ab9f54f16b71085a07952e445c8e5702aabd843ab383ed73ccbcaac6f6e"} Jul 14 14:32:17.314780 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.314757 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nvrf4" Jul 14 14:32:17.316741 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.316706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" event={"ID":"6bf2efce-2a36-4615-9946-4182f77575cf","Type":"ContainerStarted","Data":"c03994c6894bbb63f0f2ae10dafa9202272f9fe397222ff781037f83bd091072"} Jul 14 14:32:17.318586 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.318521 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" event={"ID":"d907a407-6913-474a-bbfd-f253cbc90328","Type":"ContainerStarted","Data":"c0a7b2f1db2c42b85adabae9f24f12b45700b8b94a364e86a46fea42d1a99f8d"} Jul 14 14:32:17.318586 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.318561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" event={"ID":"d907a407-6913-474a-bbfd-f253cbc90328","Type":"ContainerStarted","Data":"2dc4311e423bfd66b80eaf583c61f42539897967f68bc7e57e9c434ec768f3a1"} Jul 14 14:32:17.318778 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.318641 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:17.328635 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.328574 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bqzl7" podStartSLOduration=66.763743527 podStartE2EDuration="1m13.328557021s" totalImagesPullingTime="6.564813494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:17.327084716 +0000 UTC m=+73.886274372" watchObservedRunningTime="2026-07-14 14:32:17.328557021 +0000 UTC m=+73.887746679" Jul 14 14:32:17.343576 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.343379 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nvrf4" podStartSLOduration=33.815323966 podStartE2EDuration="38.343364021s" totalImagesPullingTime="4.528040055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:17.341878673 +0000 UTC m=+73.901068343" watchObservedRunningTime="2026-07-14 14:32:17.343364021 +0000 UTC m=+73.902553676" Jul 14 14:32:17.376937 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.376866 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5d8w" podStartSLOduration=66.587571293 podStartE2EDuration="1m13.37684803s" totalImagesPullingTime="6.789276737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:17.376636711 +0000 UTC m=+73.935826382" watchObservedRunningTime="2026-07-14 14:32:17.37684803 +0000 UTC m=+73.936037680" Jul 14 14:32:17.378214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:17.377830 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" podStartSLOduration=4.377817534 podStartE2EDuration="4.377817534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:17.361007302 +0000 UTC m=+73.920196957" watchObservedRunningTime="2026-07-14 14:32:17.377817534 +0000 UTC m=+73.937007192" Jul 14 14:32:20.476083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:20.476034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:20.582877 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:20.582844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:20.670626 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:20.670595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:20.820478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:20.820389 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:21.335041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:21.334999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h458h" event={"ID":"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0","Type":"ContainerStarted","Data":"f1733dbe6ae4e3ce475adda8b3d61d5a801bafd2c97662373ad228b176bc5ce5"} Jul 14 14:32:22.340327 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:22.340286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" event={"ID":"6bf2efce-2a36-4615-9946-4182f77575cf","Type":"ContainerStarted","Data":"aca3ef3f8453c3c02ac7b97ed6de2fd08a9f9cd3756b4e79baa33b9b1920d078"} Jul 14 14:32:22.356323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:22.356030 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fdd48cbfb-x4vr8" podStartSLOduration=4.00248162 podStartE2EDuration="9.356011604s" totalImagesPullingTime="5.353529984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:22.355454924 +0000 UTC m=+78.914644581" watchObservedRunningTime="2026-07-14 14:32:22.356011604 +0000 UTC m=+78.915201264" Jul 14 14:32:22.724607 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:22.724573 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:22.799480 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:22.799405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:23.345729 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:23.345696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h458h" event={"ID":"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0","Type":"ContainerStarted","Data":"a113f911c8e628c9864a9cbb044a51fbd2d8153a8bd46d37e6733018b3252fe6"} Jul 14 14:32:24.125880 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:24.125830 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.354998 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.354925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h458h" event={"ID":"41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0","Type":"ContainerStarted","Data":"a346f7574a165fac6ee3b17f818fc721fa90f924c175950eee8a75f9fe961b5b"} Jul 14 14:32:25.372485 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.372442 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h458h" podStartSLOduration=33.65803719 podStartE2EDuration="46.372429276s" totalImagesPullingTime="12.714392086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 14:31:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:25.371734209 +0000 UTC m=+81.930923886" watchObservedRunningTime="2026-07-14 14:32:25.372429276 +0000 UTC m=+81.931618930" Jul 14 14:32:25.389290 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.389263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.445478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.445449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.745431 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.745403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.957229 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.957199 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:25.978431 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:25.978405 2562 scope.go:117] "RemoveContainer" containerID="d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19" Jul 14 14:32:25.978604 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:32:25.978583 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-2s6bp_openshift-console-operator(b8c96acb-77ea-4835-91bc-7de45c5d6d0f)\"" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podUID="b8c96acb-77ea-4835-91bc-7de45c5d6d0f" Jul 14 14:32:26.003553 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.003500 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6dcp7"] Jul 14 14:32:26.005879 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.005863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.008179 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.008161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gfn6m\"" Jul 14 14:32:26.008318 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.008298 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 14:32:26.008402 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.008186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 14:32:26.008402 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.008186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 14:32:26.008725 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.008699 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 14:32:26.009174 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.009154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 14:32:26.009271 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.009237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 14:32:26.045855 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.045835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.108478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.108454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.129388 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-root\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-sys\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-wtmp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-textfile\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129643 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqscp\" (UniqueName: \"kubernetes.io/projected/90998f11-e74d-4816-8def-9c524696c1f3-kube-api-access-rqscp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129643 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-tls\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.129643 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.129612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-metrics-client-ca\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.211019 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.210993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.230541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqscp\" (UniqueName: \"kubernetes.io/projected/90998f11-e74d-4816-8def-9c524696c1f3-kube-api-access-rqscp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-tls\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-metrics-client-ca\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-root\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230864 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230705 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-root\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230864 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230864 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-sys\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230864 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-wtmp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.230864 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-textfile\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.231114 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.230889 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-sys\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.231114 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.231010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-wtmp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.231216 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.231160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-textfile\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.231216 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.231202 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-metrics-client-ca\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.231448 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.231429 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.233083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.233062 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.233628 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.233612 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90998f11-e74d-4816-8def-9c524696c1f3-node-exporter-tls\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.237177 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.237159 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqscp\" (UniqueName: \"kubernetes.io/projected/90998f11-e74d-4816-8def-9c524696c1f3-kube-api-access-rqscp\") pod \"node-exporter-6dcp7\" (UID: \"90998f11-e74d-4816-8def-9c524696c1f3\") " pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.310493 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.310430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.315282 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.315265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dcp7" Jul 14 14:32:26.326074 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:26.326055 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90998f11_e74d_4816_8def_9c524696c1f3.slice/crio-d57be68e2dc96b66ea02b33a596cfd65950cbe4177e41ac7099461ec40f2750b WatchSource:0}: Error finding container d57be68e2dc96b66ea02b33a596cfd65950cbe4177e41ac7099461ec40f2750b: Status 404 returned error can't find the container with id d57be68e2dc96b66ea02b33a596cfd65950cbe4177e41ac7099461ec40f2750b Jul 14 14:32:26.359179 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.359153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dcp7" event={"ID":"90998f11-e74d-4816-8def-9c524696c1f3","Type":"ContainerStarted","Data":"d57be68e2dc96b66ea02b33a596cfd65950cbe4177e41ac7099461ec40f2750b"} Jul 14 14:32:26.411205 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.411183 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.511187 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.511162 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:26.953628 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:26.953597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:27.053566 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.053531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:27.092659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.092634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:27.095478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.095458 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.097730 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.097671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 14:32:27.097841 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.097728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 14:32:27.097910 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.097720 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 14:32:27.097910 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.097863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 14:32:27.098114 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.098082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 14:32:27.098224 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.098122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 14:32:27.098224 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.098145 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 14:32:27.098224 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.098149 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4wj6t\"" Jul 14 14:32:27.099117 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.099098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 14:32:27.099223 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.099098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 14:32:27.111447 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.111425 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:27.126403 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.126349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:27.238190 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238190 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl6bs\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.238782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.238624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.293426 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.293392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:27.339930 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.339898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.339930 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.339928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340096 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.339963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340133 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340227 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340227 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl6bs\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340331 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340386 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340440 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.340875 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.340849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.341571 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.341540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.341666 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.341604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.341666 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.341636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.341821 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.341665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.342473 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.342431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343178 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343028 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343178 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343760 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343482 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343760 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343760 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343724 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.343949 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.343826 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.345205 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.345181 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.345401 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.345379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.345448 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.345438 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.348919 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.348899 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl6bs\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs\") pod \"alertmanager-main-0\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.406890 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.406867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:32:27.548981 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:27.548955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:32:27.551565 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:27.551538 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a98180_fe7b_4a3f_b286_cb8253f7245e.slice/crio-dde000963f074d275e11e071a34cbf063f767afe3d72940aca1a0e13d2fa96e9 WatchSource:0}: Error finding container dde000963f074d275e11e071a34cbf063f767afe3d72940aca1a0e13d2fa96e9: Status 404 returned error can't find the container with id dde000963f074d275e11e071a34cbf063f767afe3d72940aca1a0e13d2fa96e9 Jul 14 14:32:28.020794 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.020764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:28.122216 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.122189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:28.327951 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.327882 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nvrf4" Jul 14 14:32:28.370311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.370283 2562 generic.go:356] "Generic (PLEG): container finished" podID="90998f11-e74d-4816-8def-9c524696c1f3" containerID="c07490a2cc05525d99d8e9583c2cc8ebb176ad49b6c289306ced4b3b8747884d" exitCode=0 Jul 14 14:32:28.370472 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.370399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dcp7" event={"ID":"90998f11-e74d-4816-8def-9c524696c1f3","Type":"ContainerDied","Data":"c07490a2cc05525d99d8e9583c2cc8ebb176ad49b6c289306ced4b3b8747884d"} Jul 14 14:32:28.371985 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.371907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"dde000963f074d275e11e071a34cbf063f767afe3d72940aca1a0e13d2fa96e9"} Jul 14 14:32:28.911032 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.910943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:28.992738 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:28.992712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:29.122885 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.122854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:29.377525 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.377492 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d" exitCode=0 Jul 14 14:32:29.377640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.377589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d"} Jul 14 14:32:29.379967 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.379943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dcp7" event={"ID":"90998f11-e74d-4816-8def-9c524696c1f3","Type":"ContainerStarted","Data":"b0b89423126baeec0825e948f3dd35a0530aa3744c3c52ef6d7c025ba0833417"} Jul 14 14:32:29.380082 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.379995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dcp7" event={"ID":"90998f11-e74d-4816-8def-9c524696c1f3","Type":"ContainerStarted","Data":"ffae5f19cd18b6eb4905df9a9bf5849602ed916933822243ac5efa2c5dd918de"} Jul 14 14:32:29.424276 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.424051 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6dcp7" podStartSLOduration=3.31061336 podStartE2EDuration="4.424031999s" totalImagesPullingTime="1.034671492s" totalInitContainerRuntime="78.747147ms" isStatefulPod=true podCreationTimestamp="2026-07-14 14:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:29.423658577 +0000 UTC m=+85.982848283" watchObservedRunningTime="2026-07-14 14:32:29.424031999 +0000 UTC m=+85.983221658" Jul 14 14:32:29.451276 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:29.451252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:30.303406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.303376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-559b78d747-q74tz"] Jul 14 14:32:30.305706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.305668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.307729 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.307671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 14:32:30.308705 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.308664 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 14:32:30.308895 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.308872 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-667sp89ah5240\"" Jul 14 14:32:30.309043 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.309028 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 14:32:30.309194 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.309182 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zd54d\"" Jul 14 14:32:30.309358 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.309337 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 14:32:30.315640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.315618 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-559b78d747-q74tz"] Jul 14 14:32:30.364901 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.364877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-client-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.364901 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.364903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pld24\" (UniqueName: \"kubernetes.io/projected/fe841d35-0854-4dd9-bb8a-3138129d25b5-kube-api-access-pld24\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.365053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.364930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fe841d35-0854-4dd9-bb8a-3138129d25b5-audit-log\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.365053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.364948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-client-certs\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.365053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.365014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-tls\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.365053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.365035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-metrics-server-audit-profiles\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.365187 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.365062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.465813 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.465766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466257 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-client-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466360 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pld24\" (UniqueName: \"kubernetes.io/projected/fe841d35-0854-4dd9-bb8a-3138129d25b5-kube-api-access-pld24\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466360 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fe841d35-0854-4dd9-bb8a-3138129d25b5-audit-log\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466457 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-client-certs\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466457 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-tls\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466457 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-metrics-server-audit-profiles\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466625 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.466960 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.466922 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fe841d35-0854-4dd9-bb8a-3138129d25b5-audit-log\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.467438 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.467417 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fe841d35-0854-4dd9-bb8a-3138129d25b5-metrics-server-audit-profiles\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.469095 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.469056 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-client-ca-bundle\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.469343 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.469323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-client-certs\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.469626 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.469605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fe841d35-0854-4dd9-bb8a-3138129d25b5-secret-metrics-server-tls\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.480995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.480974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pld24\" (UniqueName: \"kubernetes.io/projected/fe841d35-0854-4dd9-bb8a-3138129d25b5-kube-api-access-pld24\") pod \"metrics-server-559b78d747-q74tz\" (UID: \"fe841d35-0854-4dd9-bb8a-3138129d25b5\") " pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.617248 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.617006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:30.778632 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.778601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:30.977506 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:30.977466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:31.023265 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.023187 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-559b78d747-q74tz"] Jul 14 14:32:31.032722 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:32:31.032699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe841d35_0854_4dd9_bb8a_3138129d25b5.slice/crio-1694f8ea8c53ad343c368eb5229194be228191c70e13bb99825f2c6f85109b47 WatchSource:0}: Error finding container 1694f8ea8c53ad343c368eb5229194be228191c70e13bb99825f2c6f85109b47: Status 404 returned error can't find the container with id 1694f8ea8c53ad343c368eb5229194be228191c70e13bb99825f2c6f85109b47 Jul 14 14:32:31.389258 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.389225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" event={"ID":"fe841d35-0854-4dd9-bb8a-3138129d25b5","Type":"ContainerStarted","Data":"1694f8ea8c53ad343c368eb5229194be228191c70e13bb99825f2c6f85109b47"} Jul 14 14:32:31.392263 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.392241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a"} Jul 14 14:32:31.392376 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.392294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341"} Jul 14 14:32:31.392376 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.392320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992"} Jul 14 14:32:31.392376 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.392344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4"} Jul 14 14:32:31.392376 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:31.392365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0"} Jul 14 14:32:32.219329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:32.219295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:32.398812 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:32.398777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" event={"ID":"fe841d35-0854-4dd9-bb8a-3138129d25b5","Type":"ContainerStarted","Data":"0fa4683dc576394eb73e805553a2e755a60b6dadef689463a271a627a9d43468"} Jul 14 14:32:32.402719 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:32.402693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerStarted","Data":"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23"} Jul 14 14:32:32.416299 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:32.416248 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" podStartSLOduration=1.139218282 podStartE2EDuration="2.416229609s" totalImagesPullingTime="1.277011327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:32.415950606 +0000 UTC m=+88.975140288" watchObservedRunningTime="2026-07-14 14:32:32.416229609 +0000 UTC m=+88.975419267" Jul 14 14:32:32.443490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:32.443453 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.681381024 podStartE2EDuration="5.443438542s" totalImagesPullingTime="3.746688355s" totalInitContainerRuntime="15.369163ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:32:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:32.442382055 +0000 UTC m=+89.001571730" watchObservedRunningTime="2026-07-14 14:32:32.443438542 +0000 UTC m=+89.002628200" Jul 14 14:32:35.571931 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:35.571894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:35.632840 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:35.632796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:35.685733 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:35.685705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:36.082295 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:36.082261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:36.134453 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:36.134425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:37.508590 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:37.508549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:37.605394 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:37.605365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:37.977766 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:37.977743 2562 scope.go:117] "RemoveContainer" containerID="d49ef979ed3de4a1d76d41f0c3fb0b9eb42327de97874da43783dfa8edf8bc19" Jul 14 14:32:38.194809 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.194769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.298462 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.298389 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.327142 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.327124 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76d4ddd784-gvblm" Jul 14 14:32:38.429541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.429513 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:32:38.429726 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.429564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-2s6bp" event={"ID":"b8c96acb-77ea-4835-91bc-7de45c5d6d0f","Type":"ContainerStarted","Data":"c65ccfd720c3654ae029c94c1001528f5b7066d411db7f895a13f71098bfbf50"} Jul 14 14:32:38.429824 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.429806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:32:38.449271 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.449228 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-2s6bp" podStartSLOduration=50.488300428 podStartE2EDuration="54.449214592s" totalImagesPullingTime="3.960914164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:32:38.448014975 +0000 UTC m=+95.007204654" watchObservedRunningTime="2026-07-14 14:32:38.449214592 +0000 UTC m=+95.008404243" Jul 14 14:32:38.462589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.462569 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-2s6bp" Jul 14 14:32:38.471433 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.471411 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.544105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.544076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.671018 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.670899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.773527 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.773492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:38.879243 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:38.879202 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:39.019531 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:39.019503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:39.166363 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:39.166336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:39.232888 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:39.232861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:39.887086 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:39.887055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:39.986987 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:39.986954 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:40.392840 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:40.392805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:40.492194 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:40.492143 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:40.689199 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:40.689124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:40.789359 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:40.789323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:43.016870 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:43.016835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:43.086399 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:43.086361 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:48.324878 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:48.324845 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bqzl7" Jul 14 14:32:48.562306 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:48.562272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:50.617446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:50.617411 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:50.617838 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:50.617468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:32:51.548813 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:51.548780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:51.649633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:51.649599 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:51.715550 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:51.715520 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:57.950191 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:57.950156 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:58.009642 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:58.009607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:58.359856 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:58.359823 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:32:58.424259 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:32:58.424227 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:05.270868 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:05.270832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:05.371526 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:05.371492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:05.971982 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:05.971947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:06.072449 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:06.072411 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:06.129094 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:06.129062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:06.388344 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:06.388302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:06.445183 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:06.445150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:09.545609 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:09.545537 2562 generic.go:356] "Generic (PLEG): container finished" podID="da93c763-cb9f-4e2c-a223-e8388c036dd5" containerID="8bc014681bfe2a75e1103d2861054bb9ceb4f5f00ed012fb58d0ab97c6ba3f2f" exitCode=0 Jul 14 14:33:09.545609 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:09.545579 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" event={"ID":"da93c763-cb9f-4e2c-a223-e8388c036dd5","Type":"ContainerDied","Data":"8bc014681bfe2a75e1103d2861054bb9ceb4f5f00ed012fb58d0ab97c6ba3f2f"} Jul 14 14:33:09.545988 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:09.545908 2562 scope.go:117] "RemoveContainer" containerID="8bc014681bfe2a75e1103d2861054bb9ceb4f5f00ed012fb58d0ab97c6ba3f2f" Jul 14 14:33:10.551621 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:10.551583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-lm4dl" event={"ID":"da93c763-cb9f-4e2c-a223-e8388c036dd5","Type":"ContainerStarted","Data":"8cd54dd6c7dbd84e502b87b3e4520526583f8b6a34a4d126b51acea3ba953e4b"} Jul 14 14:33:10.623071 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:10.623045 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:33:10.626759 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:10.626739 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-559b78d747-q74tz" Jul 14 14:33:14.571605 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:14.571570 2562 generic.go:356] "Generic (PLEG): container finished" podID="a0debee4-dd21-4be2-b9e8-b26e3b741a41" containerID="4bd8040b4a9b8777235f5ea918b81acb9fc0f96f8548cf9936460777166b055a" exitCode=0 Jul 14 14:33:14.571979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:14.571621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" event={"ID":"a0debee4-dd21-4be2-b9e8-b26e3b741a41","Type":"ContainerDied","Data":"4bd8040b4a9b8777235f5ea918b81acb9fc0f96f8548cf9936460777166b055a"} Jul 14 14:33:14.571979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:14.571924 2562 scope.go:117] "RemoveContainer" containerID="4bd8040b4a9b8777235f5ea918b81acb9fc0f96f8548cf9936460777166b055a" Jul 14 14:33:15.576450 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:15.576415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-q948n" event={"ID":"a0debee4-dd21-4be2-b9e8-b26e3b741a41","Type":"ContainerStarted","Data":"8255efe6b2756619682936322c1420ea734bd9f9beef97d6e0188e57c07b9970"} Jul 14 14:33:20.911136 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:20.911098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:20.963302 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:20.963265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:27.946719 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:27.946655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:28.031923 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:28.031887 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:42.083497 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:42.083459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:42.158986 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:42.158962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:46.338311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338280 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338526 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="alertmanager" containerID="cri-o://81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" gracePeriod=120 Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338607 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-metric" containerID="cri-o://de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" gracePeriod=120 Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338633 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-web" containerID="cri-o://bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" gracePeriod=120 Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338658 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="prom-label-proxy" containerID="cri-o://7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" gracePeriod=120 Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338697 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="config-reloader" containerID="cri-o://cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" gracePeriod=120 Jul 14 14:33:46.338747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.338699 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy" containerID="cri-o://4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" gracePeriod=120 Jul 14 14:33:46.689217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689154 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" exitCode=0 Jul 14 14:33:46.689217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689174 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" exitCode=0 Jul 14 14:33:46.689217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689179 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" exitCode=0 Jul 14 14:33:46.689217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689183 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" exitCode=0 Jul 14 14:33:46.689406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23"} Jul 14 14:33:46.689406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689290 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341"} Jul 14 14:33:46.689406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4"} Jul 14 14:33:46.689406 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:46.689340 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0"} Jul 14 14:33:47.571928 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.571901 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.622742 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.622883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622774 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.622883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622794 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.622883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622915 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.622974 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623002 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623036 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623028 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623064 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623081 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:33:47.623232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623095 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623147 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623182 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl6bs\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623465 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623235 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out\") pod \"62a98180-fe7b-4a3f-b286-cb8253f7245e\" (UID: \"62a98180-fe7b-4a3f-b286-cb8253f7245e\") " Jul 14 14:33:47.623465 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623370 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:47.623614 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623466 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-main-db\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.623614 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623485 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.623813 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.623761 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 14:33:47.625823 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.625772 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume" (OuterVolumeSpecName: "config-volume") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.626313 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.626276 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.626724 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.626693 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.626956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.626915 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:33:47.627134 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.627110 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs" (OuterVolumeSpecName: "kube-api-access-kl6bs") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "kube-api-access-kl6bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:33:47.627693 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.627649 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.628003 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.627979 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out" (OuterVolumeSpecName: "config-out") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:33:47.628104 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.628023 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.631309 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.631285 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.637233 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.637178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config" (OuterVolumeSpecName: "web-config") pod "62a98180-fe7b-4a3f-b286-cb8253f7245e" (UID: "62a98180-fe7b-4a3f-b286-cb8253f7245e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 14:33:47.695481 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695454 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" exitCode=0 Jul 14 14:33:47.695481 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695477 2562 generic.go:356] "Generic (PLEG): container finished" podID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerID="bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" exitCode=0 Jul 14 14:33:47.695630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a"} Jul 14 14:33:47.695630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695535 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.695630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992"} Jul 14 14:33:47.695630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62a98180-fe7b-4a3f-b286-cb8253f7245e","Type":"ContainerDied","Data":"dde000963f074d275e11e071a34cbf063f767afe3d72940aca1a0e13d2fa96e9"} Jul 14 14:33:47.695796 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.695639 2562 scope.go:117] "RemoveContainer" containerID="7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" Jul 14 14:33:47.702850 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.702813 2562 scope.go:117] "RemoveContainer" containerID="de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" Jul 14 14:33:47.709382 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.709366 2562 scope.go:117] "RemoveContainer" containerID="4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" Jul 14 14:33:47.716582 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.716564 2562 scope.go:117] "RemoveContainer" containerID="bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" Jul 14 14:33:47.718040 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.718021 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:47.722407 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.722389 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:47.723899 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.723884 2562 scope.go:117] "RemoveContainer" containerID="cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" Jul 14 14:33:47.724169 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724150 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-out\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724169 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724170 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724180 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724193 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-main-tls\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724204 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-cluster-tls-config\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724214 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724222 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-tls-assets\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724246 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-web-config\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724254 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62a98180-fe7b-4a3f-b286-cb8253f7245e-config-volume\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724264 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a98180-fe7b-4a3f-b286-cb8253f7245e-metrics-client-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.724319 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.724271 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl6bs\" (UniqueName: \"kubernetes.io/projected/62a98180-fe7b-4a3f-b286-cb8253f7245e-kube-api-access-kl6bs\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:33:47.730437 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.730420 2562 scope.go:117] "RemoveContainer" containerID="81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" Jul 14 14:33:47.736771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.736753 2562 scope.go:117] "RemoveContainer" containerID="6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d" Jul 14 14:33:47.743032 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743017 2562 scope.go:117] "RemoveContainer" containerID="7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" Jul 14 14:33:47.743268 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.743252 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23\": container with ID starting with 7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23 not found: ID does not exist" containerID="7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" Jul 14 14:33:47.743311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743276 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23"} err="failed to get container status \"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23\": rpc error: code = NotFound desc = could not find container \"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23\": container with ID starting with 7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23 not found: ID does not exist" Jul 14 14:33:47.743311 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743303 2562 scope.go:117] "RemoveContainer" containerID="de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" Jul 14 14:33:47.743527 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.743511 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a\": container with ID starting with de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a not found: ID does not exist" containerID="de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" Jul 14 14:33:47.743569 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743531 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a"} err="failed to get container status \"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a\": rpc error: code = NotFound desc = could not find container \"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a\": container with ID starting with de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a not found: ID does not exist" Jul 14 14:33:47.743569 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743544 2562 scope.go:117] "RemoveContainer" containerID="4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" Jul 14 14:33:47.743789 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.743775 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341\": container with ID starting with 4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341 not found: ID does not exist" containerID="4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" Jul 14 14:33:47.743839 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743794 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341"} err="failed to get container status \"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341\": rpc error: code = NotFound desc = could not find container \"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341\": container with ID starting with 4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341 not found: ID does not exist" Jul 14 14:33:47.743839 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743806 2562 scope.go:117] "RemoveContainer" containerID="bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" Jul 14 14:33:47.743988 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.743974 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992\": container with ID starting with bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992 not found: ID does not exist" containerID="bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" Jul 14 14:33:47.744027 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.743991 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992"} err="failed to get container status \"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992\": rpc error: code = NotFound desc = could not find container \"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992\": container with ID starting with bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992 not found: ID does not exist" Jul 14 14:33:47.744027 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744004 2562 scope.go:117] "RemoveContainer" containerID="cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" Jul 14 14:33:47.744223 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.744208 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4\": container with ID starting with cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4 not found: ID does not exist" containerID="cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" Jul 14 14:33:47.744256 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744228 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4"} err="failed to get container status \"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4\": rpc error: code = NotFound desc = could not find container \"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4\": container with ID starting with cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4 not found: ID does not exist" Jul 14 14:33:47.744256 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744243 2562 scope.go:117] "RemoveContainer" containerID="81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" Jul 14 14:33:47.744424 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.744412 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0\": container with ID starting with 81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0 not found: ID does not exist" containerID="81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" Jul 14 14:33:47.744463 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744427 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0"} err="failed to get container status \"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0\": rpc error: code = NotFound desc = could not find container \"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0\": container with ID starting with 81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0 not found: ID does not exist" Jul 14 14:33:47.744463 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744438 2562 scope.go:117] "RemoveContainer" containerID="6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d" Jul 14 14:33:47.744694 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:33:47.744661 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d\": container with ID starting with 6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d not found: ID does not exist" containerID="6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d" Jul 14 14:33:47.744763 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744703 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d"} err="failed to get container status \"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d\": rpc error: code = NotFound desc = could not find container \"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d\": container with ID starting with 6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d not found: ID does not exist" Jul 14 14:33:47.744763 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744724 2562 scope.go:117] "RemoveContainer" containerID="7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23" Jul 14 14:33:47.744942 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744924 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23"} err="failed to get container status \"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23\": rpc error: code = NotFound desc = could not find container \"7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23\": container with ID starting with 7d3113b18cb06341634080b66b4b99a0cba2e98557514f8996e2bd738bf19f23 not found: ID does not exist" Jul 14 14:33:47.744979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.744945 2562 scope.go:117] "RemoveContainer" containerID="de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a" Jul 14 14:33:47.745171 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745154 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a"} err="failed to get container status \"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a\": rpc error: code = NotFound desc = could not find container \"de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a\": container with ID starting with de6c0e018c70717835451d584c69cb81e4ed5082072eddacdd3bdbb8ce87616a not found: ID does not exist" Jul 14 14:33:47.745214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745172 2562 scope.go:117] "RemoveContainer" containerID="4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341" Jul 14 14:33:47.745353 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745335 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341"} err="failed to get container status \"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341\": rpc error: code = NotFound desc = could not find container \"4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341\": container with ID starting with 4c52f2e6ff04c17f583ae904f0f0cd6a4c7ff5c569a0d2054bcb461a90457341 not found: ID does not exist" Jul 14 14:33:47.745422 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745354 2562 scope.go:117] "RemoveContainer" containerID="bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992" Jul 14 14:33:47.745559 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745545 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992"} err="failed to get container status \"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992\": rpc error: code = NotFound desc = could not find container \"bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992\": container with ID starting with bb0c1bc229a14b84aa3e8442627528d52390ff9c9daa2b6f5e659437a8ff6992 not found: ID does not exist" Jul 14 14:33:47.745604 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745560 2562 scope.go:117] "RemoveContainer" containerID="cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4" Jul 14 14:33:47.745780 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745765 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4"} err="failed to get container status \"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4\": rpc error: code = NotFound desc = could not find container \"cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4\": container with ID starting with cf2b68685acb5d1494a3b84eba7e9b912f35d53fb981f46a7e7238475c6146d4 not found: ID does not exist" Jul 14 14:33:47.745780 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745780 2562 scope.go:117] "RemoveContainer" containerID="81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0" Jul 14 14:33:47.745941 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745926 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0"} err="failed to get container status \"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0\": rpc error: code = NotFound desc = could not find container \"81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0\": container with ID starting with 81790d7dc0e4f3762b04474d87520fe7fa1b5b79ed2fd3ce45e4719b0785b9f0 not found: ID does not exist" Jul 14 14:33:47.745982 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.745941 2562 scope.go:117] "RemoveContainer" containerID="6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d" Jul 14 14:33:47.746146 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.746129 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d"} err="failed to get container status \"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d\": rpc error: code = NotFound desc = could not find container \"6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d\": container with ID starting with 6ca0fb4a964799f6570a0de599cb29a84d81ca21809db50f1b322ea6fa4dec6d not found: ID does not exist" Jul 14 14:33:47.749103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749086 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:47.749328 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749316 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="init-config-reloader" Jul 14 14:33:47.749368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749331 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="init-config-reloader" Jul 14 14:33:47.749368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749340 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy" Jul 14 14:33:47.749368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749346 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy" Jul 14 14:33:47.749368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749361 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-metric" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749369 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-metric" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749382 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="config-reloader" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749387 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="config-reloader" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749393 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="alertmanager" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749406 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="alertmanager" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749415 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-web" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749420 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-web" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749425 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="prom-label-proxy" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749441 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="prom-label-proxy" Jul 14 14:33:47.749490 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749491 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-web" Jul 14 14:33:47.749801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749497 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="prom-label-proxy" Jul 14 14:33:47.749801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749505 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy" Jul 14 14:33:47.749801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749511 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="alertmanager" Jul 14 14:33:47.749801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749517 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="config-reloader" Jul 14 14:33:47.749801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.749525 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" containerName="kube-rbac-proxy-metric" Jul 14 14:33:47.753173 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.753159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.755482 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 14:33:47.755554 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 14:33:47.755668 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4wj6t\"" Jul 14 14:33:47.755762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 14:33:47.755762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755701 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 14:33:47.755762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 14:33:47.755900 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 14:33:47.755953 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.755903 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 14:33:47.756020 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.756006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 14:33:47.762234 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.762215 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 14:33:47.775356 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.775339 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:47.824799 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824799 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n66k\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-kube-api-access-6n66k\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-web-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.824968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.825238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-config-out\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.825238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.824993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.825238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.825058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.825238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.825094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.825238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.825125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925723 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925723 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925723 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925955 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925955 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925955 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n66k\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-kube-api-access-6n66k\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.925955 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.925981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-web-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-config-out\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926147 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.926728 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.926654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.927805 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.927777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c820d8-9563-4825-bd65-89e6f35eaad8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.928659 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.928634 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.928810 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.928789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929196 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929238 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929468 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929522 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929489 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c820d8-9563-4825-bd65-89e6f35eaad8-config-out\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929572 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.929968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.929944 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.930212 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.930198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c820d8-9563-4825-bd65-89e6f35eaad8-web-config\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.935408 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.935391 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n66k\" (UniqueName: \"kubernetes.io/projected/80c820d8-9563-4825-bd65-89e6f35eaad8-kube-api-access-6n66k\") pod \"alertmanager-main-0\" (UID: \"80c820d8-9563-4825-bd65-89e6f35eaad8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:47.981902 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:47.981875 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a98180-fe7b-4a3f-b286-cb8253f7245e" path="/var/lib/kubelet/pods/62a98180-fe7b-4a3f-b286-cb8253f7245e/volumes" Jul 14 14:33:48.063067 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:48.063048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 14:33:48.195568 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:48.195487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 14:33:48.198246 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:33:48.198221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c820d8_9563_4825_bd65_89e6f35eaad8.slice/crio-059e4a2f9f47f3731a8fa0391619160afee461a7053ac0decd91f28994ae8b30 WatchSource:0}: Error finding container 059e4a2f9f47f3731a8fa0391619160afee461a7053ac0decd91f28994ae8b30: Status 404 returned error can't find the container with id 059e4a2f9f47f3731a8fa0391619160afee461a7053ac0decd91f28994ae8b30 Jul 14 14:33:48.702722 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:48.702670 2562 generic.go:356] "Generic (PLEG): container finished" podID="80c820d8-9563-4825-bd65-89e6f35eaad8" containerID="30efa70d13c265ad4db2173767f011ab821e78cf87e02f39802fce81e73d2aee" exitCode=0 Jul 14 14:33:48.703166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:48.702755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerDied","Data":"30efa70d13c265ad4db2173767f011ab821e78cf87e02f39802fce81e73d2aee"} Jul 14 14:33:48.703166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:48.702803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"059e4a2f9f47f3731a8fa0391619160afee461a7053ac0decd91f28994ae8b30"} Jul 14 14:33:49.709349 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"3733e1a89a30fc7bb5246e2c6df3a3c8f806524da11e545a4364842ab56bb83c"} Jul 14 14:33:49.709706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709419 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"de3c9199f73d4b09f371ca566ae4b9bbc4d3ecde5c49b524ca5395c8af6ea62e"} Jul 14 14:33:49.709706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"6d070a120d233172978d0b3f20fd81c13522006045146bec8c8366afdd64e1ea"} Jul 14 14:33:49.709706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"397b9b6e5835169ac0908312083baa36803631d45aa2f3d1cd31e6aafe5220af"} Jul 14 14:33:49.709706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"4837d5fb2f0e9ece6c780c7629a93b85999625926fc59e9bc9d13a40116ff5de"} Jul 14 14:33:49.709706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.709513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c820d8-9563-4825-bd65-89e6f35eaad8","Type":"ContainerStarted","Data":"26667edabfb34257c28f904c7aa2e5a223350386f55cf181cae6a53217e4e38d"} Jul 14 14:33:49.736089 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:49.736038 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.717500135 podStartE2EDuration="2.73602257s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.522435ms" isStatefulPod=false podCreationTimestamp="2026-07-14 14:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:33:49.734110581 +0000 UTC m=+166.293300253" watchObservedRunningTime="2026-07-14 14:33:49.73602257 +0000 UTC m=+166.295212223" Jul 14 14:33:53.489605 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:53.489568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:54.030979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:54.030945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:54.131525 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:54.131493 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:57.954458 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:57.954419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:33:58.055969 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:33:58.055936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:18.003192 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:18.003159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:25.048105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.048071 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:25.147744 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.147717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:25.587445 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.587413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:25.688267 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.688225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:25.696361 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.696335 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5"] Jul 14 14:34:25.698533 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.698516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.701112 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.701089 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g4b55\"" Jul 14 14:34:25.701212 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.701124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 14:34:25.701212 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.701134 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 14:34:25.710111 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.710085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5"] Jul 14 14:34:25.817950 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.817920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.818105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.817965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.818105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.817994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6gw\" (UniqueName: \"kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.918333 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.918266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.918333 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.918299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6gw\" (UniqueName: \"kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.918483 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.918348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.918669 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.918652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.918746 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.918730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:25.926622 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:25.926596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6gw\" (UniqueName: \"kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:26.007582 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:26.007557 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:26.130367 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:26.130287 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5"] Jul 14 14:34:26.133029 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:34:26.133001 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode139ccda_1d27_4caa_b7c6_4ca206672c78.slice/crio-3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615 WatchSource:0}: Error finding container 3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615: Status 404 returned error can't find the container with id 3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615 Jul 14 14:34:26.845010 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:26.844976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" event={"ID":"e139ccda-1d27-4caa-b7c6-4ca206672c78","Type":"ContainerStarted","Data":"3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615"} Jul 14 14:34:29.254459 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:29.254421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:29.354793 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:29.354740 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:29.455933 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:29.455849 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:33.873660 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:33.873633 2562 generic.go:356] "Generic (PLEG): container finished" podID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerID="d055174da15babba4d3a8d21d953323197a308aa847a4ab0c7062a86226b16e3" exitCode=0 Jul 14 14:34:33.873998 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:33.873726 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" event={"ID":"e139ccda-1d27-4caa-b7c6-4ca206672c78","Type":"ContainerDied","Data":"d055174da15babba4d3a8d21d953323197a308aa847a4ab0c7062a86226b16e3"} Jul 14 14:34:36.887631 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:36.887593 2562 generic.go:356] "Generic (PLEG): container finished" podID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerID="cd94c8026b0c4e3c596bac985bc873aec17a7bbed0a92b0fa6a40da76b81387c" exitCode=0 Jul 14 14:34:36.888119 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:36.887648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" event={"ID":"e139ccda-1d27-4caa-b7c6-4ca206672c78","Type":"ContainerDied","Data":"cd94c8026b0c4e3c596bac985bc873aec17a7bbed0a92b0fa6a40da76b81387c"} Jul 14 14:34:45.925436 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:45.925336 2562 generic.go:356] "Generic (PLEG): container finished" podID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerID="c5387df5e6768a235e2417963c4a80dc83d20af9ea0d9cd2e96bf03608358897" exitCode=0 Jul 14 14:34:45.925436 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:45.925395 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" event={"ID":"e139ccda-1d27-4caa-b7c6-4ca206672c78","Type":"ContainerDied","Data":"c5387df5e6768a235e2417963c4a80dc83d20af9ea0d9cd2e96bf03608358897"} Jul 14 14:34:47.056076 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.056048 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:47.088764 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.088733 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle\") pod \"e139ccda-1d27-4caa-b7c6-4ca206672c78\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " Jul 14 14:34:47.088764 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.088770 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util\") pod \"e139ccda-1d27-4caa-b7c6-4ca206672c78\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " Jul 14 14:34:47.088960 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.088797 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh6gw\" (UniqueName: \"kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw\") pod \"e139ccda-1d27-4caa-b7c6-4ca206672c78\" (UID: \"e139ccda-1d27-4caa-b7c6-4ca206672c78\") " Jul 14 14:34:47.089459 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.089432 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle" (OuterVolumeSpecName: "bundle") pod "e139ccda-1d27-4caa-b7c6-4ca206672c78" (UID: "e139ccda-1d27-4caa-b7c6-4ca206672c78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:34:47.091106 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.091086 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw" (OuterVolumeSpecName: "kube-api-access-mh6gw") pod "e139ccda-1d27-4caa-b7c6-4ca206672c78" (UID: "e139ccda-1d27-4caa-b7c6-4ca206672c78"). InnerVolumeSpecName "kube-api-access-mh6gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:34:47.092804 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.092781 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util" (OuterVolumeSpecName: "util") pod "e139ccda-1d27-4caa-b7c6-4ca206672c78" (UID: "e139ccda-1d27-4caa-b7c6-4ca206672c78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:34:47.189882 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.189801 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:34:47.189882 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.189827 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e139ccda-1d27-4caa-b7c6-4ca206672c78-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:34:47.189882 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.189836 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh6gw\" (UniqueName: \"kubernetes.io/projected/e139ccda-1d27-4caa-b7c6-4ca206672c78-kube-api-access-mh6gw\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:34:47.934373 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.934348 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" Jul 14 14:34:47.934533 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.934370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bq2p5" event={"ID":"e139ccda-1d27-4caa-b7c6-4ca206672c78","Type":"ContainerDied","Data":"3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615"} Jul 14 14:34:47.934533 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:47.934436 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3792179ba2516aebc3b9231b0ec4a76df9c096ea8ad2c4f93da231932271a615" Jul 14 14:34:51.734730 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:51.734696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:52.529660 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:52.529622 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:53.740590 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft"] Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740849 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="extract" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740860 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="extract" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740869 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="util" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740874 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="util" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740884 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="pull" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740889 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="pull" Jul 14 14:34:53.740956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.740949 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e139ccda-1d27-4caa-b7c6-4ca206672c78" containerName="extract" Jul 14 14:34:53.742907 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.742892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.745339 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.745319 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 14:34:53.745446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.745354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:34:53.745446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.745387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gnxhd\"" Jul 14 14:34:53.756448 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.756426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft"] Jul 14 14:34:53.836911 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.836885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twr5q\" (UniqueName: \"kubernetes.io/projected/27c52e7e-966d-470a-b6ec-6679672293df-kube-api-access-twr5q\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.837042 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.836922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c52e7e-966d-470a-b6ec-6679672293df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.937297 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.937270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twr5q\" (UniqueName: \"kubernetes.io/projected/27c52e7e-966d-470a-b6ec-6679672293df-kube-api-access-twr5q\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.937428 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.937307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c52e7e-966d-470a-b6ec-6679672293df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.937651 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.937635 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27c52e7e-966d-470a-b6ec-6679672293df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:53.946063 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:53.946037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twr5q\" (UniqueName: \"kubernetes.io/projected/27c52e7e-966d-470a-b6ec-6679672293df-kube-api-access-twr5q\") pod \"cert-manager-operator-controller-manager-55c444bf86-4trft\" (UID: \"27c52e7e-966d-470a-b6ec-6679672293df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:54.051803 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:54.051751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" Jul 14 14:34:54.186516 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:54.186481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft"] Jul 14 14:34:54.190553 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:34:54.190527 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c52e7e_966d_470a_b6ec_6679672293df.slice/crio-90ec005d30b6a408ce29e16ead2c128223fe755064b94757259a67bab63dc302 WatchSource:0}: Error finding container 90ec005d30b6a408ce29e16ead2c128223fe755064b94757259a67bab63dc302: Status 404 returned error can't find the container with id 90ec005d30b6a408ce29e16ead2c128223fe755064b94757259a67bab63dc302 Jul 14 14:34:54.964630 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:54.964588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" event={"ID":"27c52e7e-966d-470a-b6ec-6679672293df","Type":"ContainerStarted","Data":"90ec005d30b6a408ce29e16ead2c128223fe755064b94757259a67bab63dc302"} Jul 14 14:34:55.351104 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:55.351073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:55.457655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:55.457621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:55.970875 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:55.970843 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" event={"ID":"27c52e7e-966d-470a-b6ec-6679672293df","Type":"ContainerStarted","Data":"5bbfebbd0cb16eb9ea4b05ffa40c420c283f50116e622c76ee3881df967364bd"} Jul 14 14:34:55.993326 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:55.993286 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4trft" podStartSLOduration=1.417033144 podStartE2EDuration="2.993271728s" totalImagesPullingTime="1.576238584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:34:55.992320194 +0000 UTC m=+232.551509861" watchObservedRunningTime="2026-07-14 14:34:55.993271728 +0000 UTC m=+232.552461382" Jul 14 14:34:56.387986 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:56.387872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:56.503323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:56.503287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:57.165287 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.165254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2"] Jul 14 14:34:57.168081 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.168060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.171073 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.171048 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 14:34:57.171225 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.171161 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 14:34:57.171944 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.171920 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g4b55\"" Jul 14 14:34:57.179061 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.179041 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2"] Jul 14 14:34:57.263353 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.263325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.263469 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.263357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.263469 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.263426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bx7\" (UniqueName: \"kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.364455 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.364431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bx7\" (UniqueName: \"kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.364559 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.364471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.364559 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.364490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.364826 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.364809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.364898 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.364842 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.378324 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.378301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bx7\" (UniqueName: \"kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.468706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.468635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:57.477512 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.477496 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:34:57.574474 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.574442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:57.612744 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.612598 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2"] Jul 14 14:34:57.615458 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:34:57.615434 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56abca4_ab30_4252_8c8a_cde64ae7971f.slice/crio-5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6 WatchSource:0}: Error finding container 5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6: Status 404 returned error can't find the container with id 5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6 Jul 14 14:34:57.986555 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.986517 2562 generic.go:356] "Generic (PLEG): container finished" podID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerID="da8ef65bd3a153bdcde6c8f20ca24061fbf1dfb50863d081455280df9c5142c8" exitCode=0 Jul 14 14:34:57.987489 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.987462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" event={"ID":"b56abca4-ab30-4252-8c8a-cde64ae7971f","Type":"ContainerDied","Data":"da8ef65bd3a153bdcde6c8f20ca24061fbf1dfb50863d081455280df9c5142c8"} Jul 14 14:34:57.987550 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:57.987517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" event={"ID":"b56abca4-ab30-4252-8c8a-cde64ae7971f","Type":"ContainerStarted","Data":"5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6"} Jul 14 14:34:58.612950 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.612913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hnfwg"] Jul 14 14:34:58.615380 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.615352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.620027 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.619992 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 14:34:58.620924 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.620906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-w4n5p\"" Jul 14 14:34:58.620924 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.620917 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 14:34:58.628988 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.628966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hnfwg"] Jul 14 14:34:58.676759 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.676696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhv9k\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-kube-api-access-zhv9k\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.676859 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.676789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.777216 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.777188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhv9k\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-kube-api-access-zhv9k\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.777379 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.777282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.786171 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.786152 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.786343 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.786324 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhv9k\" (UniqueName: \"kubernetes.io/projected/9aabcaa4-6139-47f4-af9e-b45f5d8b45bb-kube-api-access-zhv9k\") pod \"cert-manager-webhook-6486ffd997-hnfwg\" (UID: \"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:58.926413 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:58.926381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:34:59.093307 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:59.093258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hnfwg"] Jul 14 14:34:59.095398 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:34:59.095365 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aabcaa4_6139_47f4_af9e_b45f5d8b45bb.slice/crio-7f043c9959d349c0e3ae32bfad58f4e440b742f7353a77ca47fd9d9eaa05afe9 WatchSource:0}: Error finding container 7f043c9959d349c0e3ae32bfad58f4e440b742f7353a77ca47fd9d9eaa05afe9: Status 404 returned error can't find the container with id 7f043c9959d349c0e3ae32bfad58f4e440b742f7353a77ca47fd9d9eaa05afe9 Jul 14 14:34:59.480413 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:59.480378 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:59.866368 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:59.866291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:34:59.998890 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:59.998869 2562 generic.go:356] "Generic (PLEG): container finished" podID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerID="4899cf050ea20fe5bbab4b71bdba69962bb43a934ba7d9b56200a558b9da9664" exitCode=0 Jul 14 14:34:59.999005 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:34:59.998957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" event={"ID":"b56abca4-ab30-4252-8c8a-cde64ae7971f","Type":"ContainerDied","Data":"4899cf050ea20fe5bbab4b71bdba69962bb43a934ba7d9b56200a558b9da9664"} Jul 14 14:35:00.000182 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.000163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" event={"ID":"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb","Type":"ContainerStarted","Data":"7f043c9959d349c0e3ae32bfad58f4e440b742f7353a77ca47fd9d9eaa05afe9"} Jul 14 14:35:00.177831 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.177803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb"] Jul 14 14:35:00.179935 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.179916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.181996 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.181981 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vzd8l\"" Jul 14 14:35:00.188362 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.188344 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb"] Jul 14 14:35:00.292779 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.292750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwmd\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-kube-api-access-cpwmd\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.292891 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.292784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.393570 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.393515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwmd\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-kube-api-access-cpwmd\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.393570 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.393543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.400946 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.400920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.401048 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.400960 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwmd\" (UniqueName: \"kubernetes.io/projected/7e1fcb6b-0a69-4375-965a-a38fa04bcc4b-kube-api-access-cpwmd\") pod \"cert-manager-cainjector-559cdd8c87-qmlzb\" (UID: \"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.515218 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.515194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" Jul 14 14:35:00.640028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:00.640001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb"] Jul 14 14:35:00.642612 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:35:00.642580 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e1fcb6b_0a69_4375_965a_a38fa04bcc4b.slice/crio-2689e7ae0815ade34785127f5bd55a4336769397d0774fc62888f9448d89d88f WatchSource:0}: Error finding container 2689e7ae0815ade34785127f5bd55a4336769397d0774fc62888f9448d89d88f: Status 404 returned error can't find the container with id 2689e7ae0815ade34785127f5bd55a4336769397d0774fc62888f9448d89d88f Jul 14 14:35:01.005729 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:01.005696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" event={"ID":"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b","Type":"ContainerStarted","Data":"2689e7ae0815ade34785127f5bd55a4336769397d0774fc62888f9448d89d88f"} Jul 14 14:35:01.007713 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:01.007666 2562 generic.go:356] "Generic (PLEG): container finished" podID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerID="d2ed4b934cc8116cbc6361b8aa3129bdb92604f9001bb10acd309fb4ad484616" exitCode=0 Jul 14 14:35:01.007792 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:01.007718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" event={"ID":"b56abca4-ab30-4252-8c8a-cde64ae7971f","Type":"ContainerDied","Data":"d2ed4b934cc8116cbc6361b8aa3129bdb92604f9001bb10acd309fb4ad484616"} Jul 14 14:35:02.036421 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.036366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:02.140274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.140239 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:02.175849 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.175825 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:35:02.200442 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.200404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:02.209464 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.209431 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle\") pod \"b56abca4-ab30-4252-8c8a-cde64ae7971f\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " Jul 14 14:35:02.209611 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.209517 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77bx7\" (UniqueName: \"kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7\") pod \"b56abca4-ab30-4252-8c8a-cde64ae7971f\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " Jul 14 14:35:02.209705 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.209609 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util\") pod \"b56abca4-ab30-4252-8c8a-cde64ae7971f\" (UID: \"b56abca4-ab30-4252-8c8a-cde64ae7971f\") " Jul 14 14:35:02.209930 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.209898 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle" (OuterVolumeSpecName: "bundle") pod "b56abca4-ab30-4252-8c8a-cde64ae7971f" (UID: "b56abca4-ab30-4252-8c8a-cde64ae7971f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:35:02.212468 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.212446 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7" (OuterVolumeSpecName: "kube-api-access-77bx7") pod "b56abca4-ab30-4252-8c8a-cde64ae7971f" (UID: "b56abca4-ab30-4252-8c8a-cde64ae7971f"). InnerVolumeSpecName "kube-api-access-77bx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:35:02.218574 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.218551 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util" (OuterVolumeSpecName: "util") pod "b56abca4-ab30-4252-8c8a-cde64ae7971f" (UID: "b56abca4-ab30-4252-8c8a-cde64ae7971f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:35:02.310510 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.310424 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77bx7\" (UniqueName: \"kubernetes.io/projected/b56abca4-ab30-4252-8c8a-cde64ae7971f-kube-api-access-77bx7\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:02.310510 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.310464 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:02.310510 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:02.310475 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b56abca4-ab30-4252-8c8a-cde64ae7971f-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:03.019941 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:03.019847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" event={"ID":"b56abca4-ab30-4252-8c8a-cde64ae7971f","Type":"ContainerDied","Data":"5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6"} Jul 14 14:35:03.019941 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:03.019947 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ebf8833109ff89e6529eee3968be7ec6b6e17d3911fc1cd068cdd919cd5c7a6" Jul 14 14:35:03.020195 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:03.019897 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdfs2" Jul 14 14:35:04.025108 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.025070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" event={"ID":"9aabcaa4-6139-47f4-af9e-b45f5d8b45bb","Type":"ContainerStarted","Data":"7a5437e671f4e5069ffb982e02734681d5491c1db2f905afd543b64ca505f222"} Jul 14 14:35:04.025527 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.025128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:35:04.026532 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.026514 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" event={"ID":"7e1fcb6b-0a69-4375-965a-a38fa04bcc4b","Type":"ContainerStarted","Data":"3150a3362863f98c4a318199a92f5c23bdeb5040bf36789590a843d29fb747e6"} Jul 14 14:35:04.042304 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.042265 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" podStartSLOduration=1.771882516 podStartE2EDuration="6.042253117s" totalImagesPullingTime="4.270370601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:35:04.040813712 +0000 UTC m=+240.600003360" watchObservedRunningTime="2026-07-14 14:35:04.042253117 +0000 UTC m=+240.601442772" Jul 14 14:35:04.054771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.054735 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qmlzb" podStartSLOduration=1.343914992 podStartE2EDuration="4.054724747s" totalImagesPullingTime="2.710809755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:35:04.053771007 +0000 UTC m=+240.612960661" watchObservedRunningTime="2026-07-14 14:35:04.054724747 +0000 UTC m=+240.613914401" Jul 14 14:35:04.152553 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.152525 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:04.254491 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:04.254420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:07.948070 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:07.948033 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:08.046732 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:08.046702 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:08.147003 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:08.146969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:08.371980 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:08.371950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:10.032940 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:10.032909 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hnfwg" Jul 14 14:35:16.000392 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:16.000355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:16.100153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:16.100118 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:17.665252 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665222 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt"] Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665510 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="pull" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665521 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="pull" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665552 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="util" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665558 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="util" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665572 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="extract" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665578 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="extract" Jul 14 14:35:17.665633 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.665628 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b56abca4-ab30-4252-8c8a-cde64ae7971f" containerName="extract" Jul 14 14:35:17.688464 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.688439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.688464 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.688448 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt"] Jul 14 14:35:17.691053 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.691034 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 14:35:17.691362 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.691345 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 14:35:17.691413 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.691397 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g4b55\"" Jul 14 14:35:17.824346 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.824312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.824486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.824380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79hk8\" (UniqueName: \"kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.824486 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.824440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.925714 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.925627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.925863 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.925812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.925941 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.925887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79hk8\" (UniqueName: \"kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.926107 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.926087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.926168 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.926133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.935351 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.935320 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79hk8\" (UniqueName: \"kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:17.997028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:17.997005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:18.146605 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:18.146575 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt"] Jul 14 14:35:18.149780 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:35:18.149752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f7f0b5_41f1_42b8_9b29_d499ed0fdf97.slice/crio-436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c WatchSource:0}: Error finding container 436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c: Status 404 returned error can't find the container with id 436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c Jul 14 14:35:18.386199 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:18.386111 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:19.092375 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:19.092343 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerID="1adc3312cdd05fbb11e547380e40860f97bec43e87cfa4603d0f72107fb70a6c" exitCode=0 Jul 14 14:35:19.092769 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:19.092391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" event={"ID":"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97","Type":"ContainerDied","Data":"1adc3312cdd05fbb11e547380e40860f97bec43e87cfa4603d0f72107fb70a6c"} Jul 14 14:35:19.092769 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:19.092423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" event={"ID":"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97","Type":"ContainerStarted","Data":"436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c"} Jul 14 14:35:21.102251 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:21.102215 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerID="e619964060a032382f70db39e1e3add879e178a8e2175d4824c8a08033c13a65" exitCode=0 Jul 14 14:35:21.102745 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:21.102301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" event={"ID":"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97","Type":"ContainerDied","Data":"e619964060a032382f70db39e1e3add879e178a8e2175d4824c8a08033c13a65"} Jul 14 14:35:22.108901 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:22.108867 2562 generic.go:356] "Generic (PLEG): container finished" podID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerID="00bc72096357d75afe9f1a458b4f84a769542ca95ea2eb783d173d66054a67b9" exitCode=0 Jul 14 14:35:22.109307 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:22.108914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" event={"ID":"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97","Type":"ContainerDied","Data":"00bc72096357d75afe9f1a458b4f84a769542ca95ea2eb783d173d66054a67b9"} Jul 14 14:35:23.234094 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.234071 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:23.367273 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.367214 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle\") pod \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " Jul 14 14:35:23.367385 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.367309 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util\") pod \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " Jul 14 14:35:23.367385 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.367334 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79hk8\" (UniqueName: \"kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8\") pod \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\" (UID: \"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97\") " Jul 14 14:35:23.367915 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.367890 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle" (OuterVolumeSpecName: "bundle") pod "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" (UID: "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:35:23.369496 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.369473 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8" (OuterVolumeSpecName: "kube-api-access-79hk8") pod "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" (UID: "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97"). InnerVolumeSpecName "kube-api-access-79hk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:35:23.423782 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.423753 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util" (OuterVolumeSpecName: "util") pod "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" (UID: "a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:35:23.468417 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.468396 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:23.468417 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.468416 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79hk8\" (UniqueName: \"kubernetes.io/projected/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-kube-api-access-79hk8\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:23.468520 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:23.468427 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:35:24.118323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:24.118287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" event={"ID":"a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97","Type":"ContainerDied","Data":"436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c"} Jul 14 14:35:24.118323 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:24.118326 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrc2jt" Jul 14 14:35:24.118547 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:24.118334 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="436ab7d318c87bb4fbc7e951507f30d034fb57ffaab8dbc6a219f6e50f5f916c" Jul 14 14:35:25.310035 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:25.309993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:25.858284 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:25.858251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:29.636991 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:29.636950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:29.741655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:29.741621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:32.546247 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.546212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:32.617732 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.617700 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn"] Jul 14 14:35:32.618016 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618003 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="util" Jul 14 14:35:32.618058 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618018 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="util" Jul 14 14:35:32.618058 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618039 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="extract" Jul 14 14:35:32.618058 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618044 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="extract" Jul 14 14:35:32.618153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618058 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="pull" Jul 14 14:35:32.618153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618067 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="pull" Jul 14 14:35:32.618153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.618115 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f7f0b5-41f1-42b8-9b29-d499ed0fdf97" containerName="extract" Jul 14 14:35:32.624458 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.624444 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.626973 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.626952 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vz8fw\"" Jul 14 14:35:32.627081 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.627061 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 14:35:32.627762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.627745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 14:35:32.627849 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.627783 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 14:35:32.627849 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.627839 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 14:35:32.627933 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.627886 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 14:35:32.633666 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.633645 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn"] Jul 14 14:35:32.655000 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.654969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:32.735952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.735927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.736088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.735980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpmdd\" (UniqueName: \"kubernetes.io/projected/56c8ccca-07d0-4802-a266-28322dca98e5-kube-api-access-lpmdd\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.736088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.736068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c8ccca-07d0-4802-a266-28322dca98e5-manager-config\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.736202 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.736121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-metrics-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.814336 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.814270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:32.837326 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.837302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.837415 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.837341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpmdd\" (UniqueName: \"kubernetes.io/projected/56c8ccca-07d0-4802-a266-28322dca98e5-kube-api-access-lpmdd\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.837415 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.837372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c8ccca-07d0-4802-a266-28322dca98e5-manager-config\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.837415 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.837401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-metrics-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.838219 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.838158 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/56c8ccca-07d0-4802-a266-28322dca98e5-manager-config\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.839889 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.839870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.840007 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.839988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c8ccca-07d0-4802-a266-28322dca98e5-metrics-cert\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.845589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.845570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpmdd\" (UniqueName: \"kubernetes.io/projected/56c8ccca-07d0-4802-a266-28322dca98e5-kube-api-access-lpmdd\") pod \"lws-controller-manager-fc6b4b856-q2rkn\" (UID: \"56c8ccca-07d0-4802-a266-28322dca98e5\") " pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:32.904156 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.904133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:32.934026 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:32.933998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:33.079097 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.079068 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn"] Jul 14 14:35:33.081391 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:35:33.081359 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c8ccca_07d0_4802_a266_28322dca98e5.slice/crio-c0dee7aaf3cf971a15762c12b2e3abaa3c1576e8171c3d3be1dc8953abfa4a12 WatchSource:0}: Error finding container c0dee7aaf3cf971a15762c12b2e3abaa3c1576e8171c3d3be1dc8953abfa4a12: Status 404 returned error can't find the container with id c0dee7aaf3cf971a15762c12b2e3abaa3c1576e8171c3d3be1dc8953abfa4a12 Jul 14 14:35:33.157023 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.156987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" event={"ID":"56c8ccca-07d0-4802-a266-28322dca98e5","Type":"ContainerStarted","Data":"c0dee7aaf3cf971a15762c12b2e3abaa3c1576e8171c3d3be1dc8953abfa4a12"} Jul 14 14:35:33.392254 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.392170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:33.614193 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.614156 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:33.754056 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.754028 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:33.831158 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.831135 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj"] Jul 14 14:35:33.834992 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.834975 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.845249 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.845224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 14:35:33.845362 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.845301 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 14:35:33.845443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.845302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 14:35:33.845443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.845245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-62jlr\"" Jul 14 14:35:33.845567 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.845395 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 14:35:33.877730 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.877708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj"] Jul 14 14:35:33.947950 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.947916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-tmp\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.948115 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.947965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9t6\" (UniqueName: \"kubernetes.io/projected/143bf469-131a-4662-a428-e5682bb29899-kube-api-access-8j9t6\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.948115 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.948040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.948230 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.948118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-manifests\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.948230 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.948177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:33.982625 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:33.982594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.049138 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-tmp\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.049138 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9t6\" (UniqueName: \"kubernetes.io/projected/143bf469-131a-4662-a428-e5682bb29899-kube-api-access-8j9t6\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.049347 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.049347 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-manifests\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.049347 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.049640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.049611 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-manifests\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.051925 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.051871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/143bf469-131a-4662-a428-e5682bb29899-tmp\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.052064 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.052035 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.052129 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.052037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/143bf469-131a-4662-a428-e5682bb29899-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.060881 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.060841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9t6\" (UniqueName: \"kubernetes.io/projected/143bf469-131a-4662-a428-e5682bb29899-kube-api-access-8j9t6\") pod \"opendatahub-operator-controller-manager-b4469fb8c-mtxlj\" (UID: \"143bf469-131a-4662-a428-e5682bb29899\") " pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.084285 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.084242 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.147263 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.147236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:34.187217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.187182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.262631 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.262598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.313517 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.313483 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj"] Jul 14 14:35:34.361768 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.361739 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.448646 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.448539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.599371 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.599261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:34.615163 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:35:34.615134 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143bf469_131a_4662_a428_e5682bb29899.slice/crio-a12cca482bdff35c7294a4529d71207f67f3b6a6d82fc1e226eaed1c8832d2bc WatchSource:0}: Error finding container a12cca482bdff35c7294a4529d71207f67f3b6a6d82fc1e226eaed1c8832d2bc: Status 404 returned error can't find the container with id a12cca482bdff35c7294a4529d71207f67f3b6a6d82fc1e226eaed1c8832d2bc Jul 14 14:35:34.695989 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:34.695966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:35.168030 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:35.167990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" event={"ID":"143bf469-131a-4662-a428-e5682bb29899","Type":"ContainerStarted","Data":"a12cca482bdff35c7294a4529d71207f67f3b6a6d82fc1e226eaed1c8832d2bc"} Jul 14 14:35:35.169491 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:35.169465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" event={"ID":"56c8ccca-07d0-4802-a266-28322dca98e5","Type":"ContainerStarted","Data":"b9f6617c3329cc15d1cc8ff8da95ace63e7ba49594e2d55736aa27f395bb5caa"} Jul 14 14:35:35.169605 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:35.169568 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:35.192940 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:35.192899 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" podStartSLOduration=1.60008094 podStartE2EDuration="3.192886005s" totalImagesPullingTime="1.592805065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:35:35.190988807 +0000 UTC m=+271.750178463" watchObservedRunningTime="2026-07-14 14:35:35.192886005 +0000 UTC m=+271.752075659" Jul 14 14:35:38.185296 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:38.185268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" event={"ID":"143bf469-131a-4662-a428-e5682bb29899","Type":"ContainerStarted","Data":"e409e2f830e689226d23844f3c70ae9713f878a7db05a295667facec055e25e0"} Jul 14 14:35:39.191608 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:39.191579 2562 generic.go:356] "Generic (PLEG): container finished" podID="143bf469-131a-4662-a428-e5682bb29899" containerID="e409e2f830e689226d23844f3c70ae9713f878a7db05a295667facec055e25e0" exitCode=0 Jul 14 14:35:39.192005 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:39.191642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" event={"ID":"143bf469-131a-4662-a428-e5682bb29899","Type":"ContainerDied","Data":"e409e2f830e689226d23844f3c70ae9713f878a7db05a295667facec055e25e0"} Jul 14 14:35:40.198874 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:40.198839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" event={"ID":"143bf469-131a-4662-a428-e5682bb29899","Type":"ContainerStarted","Data":"40f32576b372cb3650f47fcaf02823f11ff9e54c4d52f60ebe15d9bcad570742"} Jul 14 14:35:40.199289 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:40.199019 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:40.225299 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:40.225252 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" podStartSLOduration=2.337722771 podStartE2EDuration="7.225238853s" totalImagesPullingTime="3.798412236s" totalInitContainerRuntime="1.089103846s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:35:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:35:40.223399753 +0000 UTC m=+276.782589408" watchObservedRunningTime="2026-07-14 14:35:40.225238853 +0000 UTC m=+276.784428507" Jul 14 14:35:46.177817 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:46.177785 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fc6b4b856-q2rkn" Jul 14 14:35:51.205725 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:51.205647 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4469fb8c-mtxlj" Jul 14 14:35:54.057269 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:54.057230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:54.214007 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:54.213970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:54.473387 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:54.473346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:54.993743 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:54.993707 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:55.171162 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:55.171120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:55.253775 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:55.253669 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:55.356119 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:55.356083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:55.466324 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:55.466294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:55.603259 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:55.603171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:56.125900 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.125862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:56.144946 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.144917 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hvlb5"] Jul 14 14:35:56.149454 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.149429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.153002 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.152974 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zlrp6\"" Jul 14 14:35:56.155544 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.155526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 14:35:56.161645 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.161619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hvlb5"] Jul 14 14:35:56.219433 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.219404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:56.224458 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.224437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.224589 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.224573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2kl7\" (UniqueName: \"kubernetes.io/projected/991bffc6-d089-4f2c-a6ec-172f789415a8-kube-api-access-c2kl7\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.325322 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.325285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2kl7\" (UniqueName: \"kubernetes.io/projected/991bffc6-d089-4f2c-a6ec-172f789415a8-kube-api-access-c2kl7\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.325489 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.325331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.325489 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:35:56.325460 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 14 14:35:56.325560 ip-10-0-135-215 kubenswrapper[2562]: E0714 14:35:56.325517 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs podName:991bffc6-d089-4f2c-a6ec-172f789415a8 nodeName:}" failed. No retries permitted until 2026-07-14 14:35:56.825500224 +0000 UTC m=+293.384689857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs") pod "model-serving-api-54d89bd5fc-hvlb5" (UID: "991bffc6-d089-4f2c-a6ec-172f789415a8") : secret "model-serving-api-tls" not found Jul 14 14:35:56.334374 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.334350 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2kl7\" (UniqueName: \"kubernetes.io/projected/991bffc6-d089-4f2c-a6ec-172f789415a8-kube-api-access-c2kl7\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.660670 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.660628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:56.828881 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.828848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:56.831412 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:56.831379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/991bffc6-d089-4f2c-a6ec-172f789415a8-tls-certs\") pod \"model-serving-api-54d89bd5fc-hvlb5\" (UID: \"991bffc6-d089-4f2c-a6ec-172f789415a8\") " pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:57.063336 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:57.063296 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:57.207783 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:57.207760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hvlb5"] Jul 14 14:35:57.210293 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:35:57.210265 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991bffc6_d089_4f2c_a6ec_172f789415a8.slice/crio-4bdea7176ea493ef31d94aa6bbdb75a54ad34ca8e98760fff00f7c391456b45b WatchSource:0}: Error finding container 4bdea7176ea493ef31d94aa6bbdb75a54ad34ca8e98760fff00f7c391456b45b: Status 404 returned error can't find the container with id 4bdea7176ea493ef31d94aa6bbdb75a54ad34ca8e98760fff00f7c391456b45b Jul 14 14:35:57.278466 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:57.278432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" event={"ID":"991bffc6-d089-4f2c-a6ec-172f789415a8","Type":"ContainerStarted","Data":"4bdea7176ea493ef31d94aa6bbdb75a54ad34ca8e98760fff00f7c391456b45b"} Jul 14 14:35:57.329109 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:57.329021 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:35:59.291740 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:59.291705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" event={"ID":"991bffc6-d089-4f2c-a6ec-172f789415a8","Type":"ContainerStarted","Data":"c4b9a0c8325af99d33b53f5ecf4cd60255efc12354b4ff2bb80d38152e76e01f"} Jul 14 14:35:59.292140 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:59.291795 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:35:59.309324 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:35:59.309277 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" podStartSLOduration=1.370033553 podStartE2EDuration="3.309261807s" totalImagesPullingTime="1.939228254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:35:59.308345675 +0000 UTC m=+295.867535354" watchObservedRunningTime="2026-07-14 14:35:59.309261807 +0000 UTC m=+295.868451461" Jul 14 14:36:02.135587 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.135552 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t"] Jul 14 14:36:02.138736 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.138721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.141304 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141244 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 14:36:02.141304 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 14:36:02.141304 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141289 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 14:36:02.141304 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h5r2l\"" Jul 14 14:36:02.141621 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141310 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 14:36:02.141621 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141266 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 14:36:02.141621 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.141263 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 14:36:02.155191 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.155173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t"] Jul 14 14:36:02.175850 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.175952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltmfp\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-kube-api-access-ltmfp\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.175952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.175952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.176103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.176103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.175980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a048b90-af4b-4475-b411-60650352e5e3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.176103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.176026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.276769 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.276944 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.276944 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a048b90-af4b-4475-b411-60650352e5e3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.276944 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.276944 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.277214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltmfp\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-kube-api-access-ltmfp\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.277214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.276989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.277576 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.277516 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.279269 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.279243 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.279378 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.279314 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.279572 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.279553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a048b90-af4b-4475-b411-60650352e5e3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.279658 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.279638 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a048b90-af4b-4475-b411-60650352e5e3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.285360 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.285325 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.285546 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.285527 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltmfp\" (UniqueName: \"kubernetes.io/projected/2a048b90-af4b-4475-b411-60650352e5e3-kube-api-access-ltmfp\") pod \"istiod-openshift-gateway-94bb8fbfd-mbg5t\" (UID: \"2a048b90-af4b-4475-b411-60650352e5e3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.448328 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.448251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:02.532422 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.532389 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:02.604508 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:02.604483 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t"] Jul 14 14:36:02.605458 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:36:02.605431 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a048b90_af4b_4475_b411_60650352e5e3.slice/crio-074f011f2686a6e5f38641ea8cac43ff84a84c90c04421b635a4837b9f8da62d WatchSource:0}: Error finding container 074f011f2686a6e5f38641ea8cac43ff84a84c90c04421b635a4837b9f8da62d: Status 404 returned error can't find the container with id 074f011f2686a6e5f38641ea8cac43ff84a84c90c04421b635a4837b9f8da62d Jul 14 14:36:03.312425 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.312390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" event={"ID":"2a048b90-af4b-4475-b411-60650352e5e3","Type":"ContainerStarted","Data":"074f011f2686a6e5f38641ea8cac43ff84a84c90c04421b635a4837b9f8da62d"} Jul 14 14:36:03.805083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.805055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:36:03.806335 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.806310 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:36:03.819080 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.819059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:36:03.819915 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.819893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:36:03.822891 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:03.822872 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 14:36:04.208151 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:04.208073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:05.541324 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:05.541292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:05.667032 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:05.666994 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:05.794028 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:05.793938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:06.058317 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:06.058227 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:06.206968 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:06.206930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:06.911432 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:06.911405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:07.028160 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:07.028122 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:07.172067 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:07.171979 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:10.300591 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:10.300554 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hvlb5" Jul 14 14:36:16.924088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:16.924052 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 14 14:36:16.924346 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:16.924120 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 14 14:36:17.380840 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:17.380801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" event={"ID":"2a048b90-af4b-4475-b411-60650352e5e3","Type":"ContainerStarted","Data":"d7cb83497728d51581d2122d10d2ede284ae239d735d55799113b299e52e999c"} Jul 14 14:36:17.381042 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:17.380956 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:17.382609 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:17.382581 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mbg5t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 14:36:17.382748 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:17.382635 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" podUID="2a048b90-af4b-4475-b411-60650352e5e3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 14:36:17.406793 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:17.406742 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" podStartSLOduration=1.090540807 podStartE2EDuration="15.406727944s" totalImagesPullingTime="14.316187137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:36:17.399120914 +0000 UTC m=+313.958310590" watchObservedRunningTime="2026-07-14 14:36:17.406727944 +0000 UTC m=+313.965917599" Jul 14 14:36:18.386114 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:18.386083 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mbg5t" Jul 14 14:36:55.598723 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:55.598612 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:55.669905 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:55.669871 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:55.771465 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:55.771434 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:56.510543 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:56.510515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:36:56.710726 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:36:56.710674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:01.731578 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:01.731532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:01.831956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:01.831923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:11.121654 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.121622 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69"] Jul 14 14:37:11.124081 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.124065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.126346 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.126324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 14:37:11.126458 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.126324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 14:37:11.126945 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.126930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6c6jq\"" Jul 14 14:37:11.132648 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.132626 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69"] Jul 14 14:37:11.217960 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.217933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9pmh\" (UniqueName: \"kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.218083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.217982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.218083 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.218005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.318515 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.318494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.318648 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.318550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9pmh\" (UniqueName: \"kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.318648 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.318599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.318950 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.318931 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.319013 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.318941 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.328015 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.327997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9pmh\" (UniqueName: \"kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.434261 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.434208 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:11.564818 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.564775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69"] Jul 14 14:37:11.567144 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:37:11.567116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234f4fc6_d0c4_4065_a38b_dc7114e958b2.slice/crio-d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354 WatchSource:0}: Error finding container d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354: Status 404 returned error can't find the container with id d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354 Jul 14 14:37:11.642423 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.642393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerStarted","Data":"c97f7c2f9b33ac3b145db4735d8c434cfa345aff5ce648fec487d2da21f6f727"} Jul 14 14:37:11.642541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.642448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerStarted","Data":"d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354"} Jul 14 14:37:11.727647 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.727621 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx"] Jul 14 14:37:11.730578 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.730559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.739695 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.739655 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx"] Jul 14 14:37:11.822838 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.822812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.822972 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.822867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzjx\" (UniqueName: \"kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.823043 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.822980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.924105 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.924065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.924232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.924118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.924232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.924187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzjx\" (UniqueName: \"kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.924430 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.924410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.924494 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.924462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:11.933404 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:11.933380 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzjx\" (UniqueName: \"kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:12.040504 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.040439 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:12.128148 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.128125 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl"] Jul 14 14:37:12.131192 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.131174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.139761 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.139738 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl"] Jul 14 14:37:12.172561 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.172516 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx"] Jul 14 14:37:12.174698 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:37:12.174660 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc17379_709d_408d_b96f_624c806dac73.slice/crio-69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2 WatchSource:0}: Error finding container 69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2: Status 404 returned error can't find the container with id 69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2 Jul 14 14:37:12.225541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.225516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9rvv\" (UniqueName: \"kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.225627 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.225553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.225627 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.225574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.326577 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.326521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9rvv\" (UniqueName: \"kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.326577 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.326562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.326747 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.326581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.326937 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.326919 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.326987 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.326948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.334952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.334928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9rvv\" (UniqueName: \"kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.441938 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.441914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:12.528594 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.528560 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr"] Jul 14 14:37:12.535159 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.535138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.540353 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.540328 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr"] Jul 14 14:37:12.576801 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.576739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl"] Jul 14 14:37:12.580123 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:37:12.580097 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b902b9_0360_4f37_8671_1b8345fcd807.slice/crio-9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b WatchSource:0}: Error finding container 9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b: Status 404 returned error can't find the container with id 9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b Jul 14 14:37:12.628573 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.628548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.628694 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.628581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.628694 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.628663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flh4v\" (UniqueName: \"kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.648002 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.647973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerStarted","Data":"a0878a3beef862da2d7aa3709ab8974c999b02b078d3e13459f2a5b3de604b08"} Jul 14 14:37:12.648099 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.648035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerStarted","Data":"9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b"} Jul 14 14:37:12.649430 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.649402 2562 generic.go:356] "Generic (PLEG): container finished" podID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerID="c97f7c2f9b33ac3b145db4735d8c434cfa345aff5ce648fec487d2da21f6f727" exitCode=0 Jul 14 14:37:12.649523 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.649488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerDied","Data":"c97f7c2f9b33ac3b145db4735d8c434cfa345aff5ce648fec487d2da21f6f727"} Jul 14 14:37:12.649920 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.649904 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 14:37:12.651056 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.651038 2562 generic.go:356] "Generic (PLEG): container finished" podID="5fc17379-709d-408d-b96f-624c806dac73" containerID="b80b72cdaf157333fee995f6d57731b78aa1165da31325bca19bad64f38da1ac" exitCode=0 Jul 14 14:37:12.651154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.651090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" event={"ID":"5fc17379-709d-408d-b96f-624c806dac73","Type":"ContainerDied","Data":"b80b72cdaf157333fee995f6d57731b78aa1165da31325bca19bad64f38da1ac"} Jul 14 14:37:12.651154 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.651116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" event={"ID":"5fc17379-709d-408d-b96f-624c806dac73","Type":"ContainerStarted","Data":"69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2"} Jul 14 14:37:12.729328 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.729300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.729506 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.729475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flh4v\" (UniqueName: \"kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.729639 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.729594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.729725 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.729704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.729921 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.729904 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.738978 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.738955 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flh4v\" (UniqueName: \"kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.847771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.847714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:12.976123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:12.976098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr"] Jul 14 14:37:12.977652 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:37:12.977627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f566ef_efb0_4b40_ac3c_34ff044e4d4a.slice/crio-7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef WatchSource:0}: Error finding container 7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef: Status 404 returned error can't find the container with id 7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef Jul 14 14:37:13.657135 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.657107 2562 generic.go:356] "Generic (PLEG): container finished" podID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerID="ad0b542f15626129a6c7bf13fb1721d1392822224ebf4af241d0340a1464f279" exitCode=0 Jul 14 14:37:13.657446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.657196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" event={"ID":"81f566ef-efb0-4b40-ac3c-34ff044e4d4a","Type":"ContainerDied","Data":"ad0b542f15626129a6c7bf13fb1721d1392822224ebf4af241d0340a1464f279"} Jul 14 14:37:13.657446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.657255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" event={"ID":"81f566ef-efb0-4b40-ac3c-34ff044e4d4a","Type":"ContainerStarted","Data":"7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef"} Jul 14 14:37:13.658937 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.658914 2562 generic.go:356] "Generic (PLEG): container finished" podID="89b902b9-0360-4f37-8671-1b8345fcd807" containerID="a0878a3beef862da2d7aa3709ab8974c999b02b078d3e13459f2a5b3de604b08" exitCode=0 Jul 14 14:37:13.659051 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.658989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerDied","Data":"a0878a3beef862da2d7aa3709ab8974c999b02b078d3e13459f2a5b3de604b08"} Jul 14 14:37:13.661121 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.661096 2562 generic.go:356] "Generic (PLEG): container finished" podID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerID="116ed75584182767943214f9b9925a5c61dbfc280bbf8380103557d53c3e2f54" exitCode=0 Jul 14 14:37:13.661214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:13.661135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerDied","Data":"116ed75584182767943214f9b9925a5c61dbfc280bbf8380103557d53c3e2f54"} Jul 14 14:37:14.674267 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:14.674232 2562 generic.go:356] "Generic (PLEG): container finished" podID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerID="4739900db51974c5a885d5684c9b8077ebc394187a9864fa884a6660dbf1abe5" exitCode=0 Jul 14 14:37:14.674755 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:14.674319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerDied","Data":"4739900db51974c5a885d5684c9b8077ebc394187a9864fa884a6660dbf1abe5"} Jul 14 14:37:14.676152 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:14.676127 2562 generic.go:356] "Generic (PLEG): container finished" podID="5fc17379-709d-408d-b96f-624c806dac73" containerID="e322e3dc9273d76d6004e0990dd9f1f0d2f2b09c74933f042b3ccd2f5262b0cb" exitCode=0 Jul 14 14:37:14.676247 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:14.676185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" event={"ID":"5fc17379-709d-408d-b96f-624c806dac73","Type":"ContainerDied","Data":"e322e3dc9273d76d6004e0990dd9f1f0d2f2b09c74933f042b3ccd2f5262b0cb"} Jul 14 14:37:15.684645 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.684563 2562 generic.go:356] "Generic (PLEG): container finished" podID="5fc17379-709d-408d-b96f-624c806dac73" containerID="c876e675e789f43c88f193129b7122064c407b2800c4e1deeaecee261669dd11" exitCode=0 Jul 14 14:37:15.684645 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.684624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" event={"ID":"5fc17379-709d-408d-b96f-624c806dac73","Type":"ContainerDied","Data":"c876e675e789f43c88f193129b7122064c407b2800c4e1deeaecee261669dd11"} Jul 14 14:37:15.686568 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.686542 2562 generic.go:356] "Generic (PLEG): container finished" podID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerID="1436877fd68dc759f8314350ffa6ce89d65fe4c04cf904d1aadaf627dd744ce7" exitCode=0 Jul 14 14:37:15.686697 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.686623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" event={"ID":"81f566ef-efb0-4b40-ac3c-34ff044e4d4a","Type":"ContainerDied","Data":"1436877fd68dc759f8314350ffa6ce89d65fe4c04cf904d1aadaf627dd744ce7"} Jul 14 14:37:15.688513 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.688447 2562 generic.go:356] "Generic (PLEG): container finished" podID="89b902b9-0360-4f37-8671-1b8345fcd807" containerID="5601d5c147bc392be2a890a9d977a14b8c4099fd6c9e70ee34ef60c1646afb70" exitCode=0 Jul 14 14:37:15.688647 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.688531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerDied","Data":"5601d5c147bc392be2a890a9d977a14b8c4099fd6c9e70ee34ef60c1646afb70"} Jul 14 14:37:15.838661 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.838627 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:15.960757 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.960697 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9pmh\" (UniqueName: \"kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh\") pod \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " Jul 14 14:37:15.960757 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.960731 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util\") pod \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " Jul 14 14:37:15.960956 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.960763 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle\") pod \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\" (UID: \"234f4fc6-d0c4-4065-a38b-dc7114e958b2\") " Jul 14 14:37:15.961331 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.961297 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle" (OuterVolumeSpecName: "bundle") pod "234f4fc6-d0c4-4065-a38b-dc7114e958b2" (UID: "234f4fc6-d0c4-4065-a38b-dc7114e958b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:15.962891 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.962872 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh" (OuterVolumeSpecName: "kube-api-access-f9pmh") pod "234f4fc6-d0c4-4065-a38b-dc7114e958b2" (UID: "234f4fc6-d0c4-4065-a38b-dc7114e958b2"). InnerVolumeSpecName "kube-api-access-f9pmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:37:15.966171 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:15.966147 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util" (OuterVolumeSpecName: "util") pod "234f4fc6-d0c4-4065-a38b-dc7114e958b2" (UID: "234f4fc6-d0c4-4065-a38b-dc7114e958b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:16.061539 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.061513 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9pmh\" (UniqueName: \"kubernetes.io/projected/234f4fc6-d0c4-4065-a38b-dc7114e958b2-kube-api-access-f9pmh\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:16.061539 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.061537 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:16.061666 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.061550 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234f4fc6-d0c4-4065-a38b-dc7114e958b2-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:16.695816 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.695716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" event={"ID":"234f4fc6-d0c4-4065-a38b-dc7114e958b2","Type":"ContainerDied","Data":"d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354"} Jul 14 14:37:16.695816 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.695755 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69" Jul 14 14:37:16.695816 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.695776 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d90c63e73b32e6bdfd5c5c0b79eca3614df011308be325c34fe469d08868d354" Jul 14 14:37:16.698764 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.698737 2562 generic.go:356] "Generic (PLEG): container finished" podID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerID="fe3f4f00ff1e41a9de8e49fd65b8a9f66fe3cd919f1b16bd0cb8c38fea52311f" exitCode=0 Jul 14 14:37:16.698921 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.698821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" event={"ID":"81f566ef-efb0-4b40-ac3c-34ff044e4d4a","Type":"ContainerDied","Data":"fe3f4f00ff1e41a9de8e49fd65b8a9f66fe3cd919f1b16bd0cb8c38fea52311f"} Jul 14 14:37:16.701252 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.701231 2562 generic.go:356] "Generic (PLEG): container finished" podID="89b902b9-0360-4f37-8671-1b8345fcd807" containerID="262d8d248309bb2db2bea3824ecd3d303a8be63c09018b9a7fcad52e0123ddce" exitCode=0 Jul 14 14:37:16.701335 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.701319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerDied","Data":"262d8d248309bb2db2bea3824ecd3d303a8be63c09018b9a7fcad52e0123ddce"} Jul 14 14:37:16.832853 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.832831 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:16.968771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.968710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nzjx\" (UniqueName: \"kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx\") pod \"5fc17379-709d-408d-b96f-624c806dac73\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " Jul 14 14:37:16.968771 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.968768 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle\") pod \"5fc17379-709d-408d-b96f-624c806dac73\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " Jul 14 14:37:16.968960 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.968814 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util\") pod \"5fc17379-709d-408d-b96f-624c806dac73\" (UID: \"5fc17379-709d-408d-b96f-624c806dac73\") " Jul 14 14:37:16.969259 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.969228 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle" (OuterVolumeSpecName: "bundle") pod "5fc17379-709d-408d-b96f-624c806dac73" (UID: "5fc17379-709d-408d-b96f-624c806dac73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:16.971106 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.971079 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx" (OuterVolumeSpecName: "kube-api-access-6nzjx") pod "5fc17379-709d-408d-b96f-624c806dac73" (UID: "5fc17379-709d-408d-b96f-624c806dac73"). InnerVolumeSpecName "kube-api-access-6nzjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:37:16.974349 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:16.974324 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util" (OuterVolumeSpecName: "util") pod "5fc17379-709d-408d-b96f-624c806dac73" (UID: "5fc17379-709d-408d-b96f-624c806dac73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:17.069320 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.069282 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nzjx\" (UniqueName: \"kubernetes.io/projected/5fc17379-709d-408d-b96f-624c806dac73-kube-api-access-6nzjx\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:17.069320 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.069315 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:17.069320 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.069324 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc17379-709d-408d-b96f-624c806dac73-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:17.707887 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.707855 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" Jul 14 14:37:17.707887 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.707877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx" event={"ID":"5fc17379-709d-408d-b96f-624c806dac73","Type":"ContainerDied","Data":"69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2"} Jul 14 14:37:17.708446 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.707955 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69bc1b5cc59643bf7ec0dda35706436d9d50cd6a85b14679ccbcb3a70fcb45d2" Jul 14 14:37:17.842283 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.842247 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:17.878178 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.878155 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:17.977567 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977541 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle\") pod \"89b902b9-0360-4f37-8671-1b8345fcd807\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " Jul 14 14:37:17.977761 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977578 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util\") pod \"89b902b9-0360-4f37-8671-1b8345fcd807\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " Jul 14 14:37:17.977761 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977603 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9rvv\" (UniqueName: \"kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv\") pod \"89b902b9-0360-4f37-8671-1b8345fcd807\" (UID: \"89b902b9-0360-4f37-8671-1b8345fcd807\") " Jul 14 14:37:17.977761 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977728 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flh4v\" (UniqueName: \"kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v\") pod \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " Jul 14 14:37:17.977761 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977762 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle\") pod \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " Jul 14 14:37:17.977995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.977800 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util\") pod \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\" (UID: \"81f566ef-efb0-4b40-ac3c-34ff044e4d4a\") " Jul 14 14:37:17.978416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.978382 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle" (OuterVolumeSpecName: "bundle") pod "81f566ef-efb0-4b40-ac3c-34ff044e4d4a" (UID: "81f566ef-efb0-4b40-ac3c-34ff044e4d4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:17.979035 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.979010 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle" (OuterVolumeSpecName: "bundle") pod "89b902b9-0360-4f37-8671-1b8345fcd807" (UID: "89b902b9-0360-4f37-8671-1b8345fcd807"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:17.980124 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.980092 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v" (OuterVolumeSpecName: "kube-api-access-flh4v") pod "81f566ef-efb0-4b40-ac3c-34ff044e4d4a" (UID: "81f566ef-efb0-4b40-ac3c-34ff044e4d4a"). InnerVolumeSpecName "kube-api-access-flh4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:37:17.980245 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.980227 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv" (OuterVolumeSpecName: "kube-api-access-n9rvv") pod "89b902b9-0360-4f37-8671-1b8345fcd807" (UID: "89b902b9-0360-4f37-8671-1b8345fcd807"). InnerVolumeSpecName "kube-api-access-n9rvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 14:37:17.986182 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.986158 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util" (OuterVolumeSpecName: "util") pod "81f566ef-efb0-4b40-ac3c-34ff044e4d4a" (UID: "81f566ef-efb0-4b40-ac3c-34ff044e4d4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:17.986182 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:17.986170 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util" (OuterVolumeSpecName: "util") pod "89b902b9-0360-4f37-8671-1b8345fcd807" (UID: "89b902b9-0360-4f37-8671-1b8345fcd807"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 14:37:18.078982 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.078957 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.078982 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.078978 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9rvv\" (UniqueName: \"kubernetes.io/projected/89b902b9-0360-4f37-8671-1b8345fcd807-kube-api-access-n9rvv\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.079123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.078989 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flh4v\" (UniqueName: \"kubernetes.io/projected/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-kube-api-access-flh4v\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.079123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.078998 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.079123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.079007 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81f566ef-efb0-4b40-ac3c-34ff044e4d4a-util\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.079123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.079014 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89b902b9-0360-4f37-8671-1b8345fcd807-bundle\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 14:37:18.715562 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.715526 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" Jul 14 14:37:18.715562 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.715552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr" event={"ID":"81f566ef-efb0-4b40-ac3c-34ff044e4d4a","Type":"ContainerDied","Data":"7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef"} Jul 14 14:37:18.716153 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.715604 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7adb313874cd9430570d52f22e409298fbc7704b5195f19c2702213f624280ef" Jul 14 14:37:18.717918 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.717890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" event={"ID":"89b902b9-0360-4f37-8671-1b8345fcd807","Type":"ContainerDied","Data":"9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b"} Jul 14 14:37:18.718057 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.717940 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ba534658383140bb25401ee66b3e9fec866214b60064db89e19a1b018d2c49b" Jul 14 14:37:18.718057 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:18.718011 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl" Jul 14 14:37:25.075128 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:25.075092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:28.990640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:28.990602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:32.117379 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:32.117347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:32.855992 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:32.855960 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:33.525085 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:33.525056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:33.724236 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:33.724192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:36.933370 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:36.933335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:37.078992 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:37.078965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:37.176198 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:37.176167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:39.694535 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:39.694495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:41.061998 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:41.061966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:41.164301 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:41.164264 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:45.213978 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:45.213922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:45.314548 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:45.314522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:51.022232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:51.022194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:51.122110 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:51.122078 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:53.886566 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:53.886536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:53.988023 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:53.987998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:56.908474 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:56.908437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:57.012390 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:57.012346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:59.399078 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:59.399042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:37:59.504102 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:37:59.504063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:02.331314 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:02.331276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:02.709443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:02.709360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:02.810035 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:02.809983 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:02.910960 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:02.910927 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:11.634300 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:11.634260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:11.734882 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:11.734850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:14.635847 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:14.635809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:14.738621 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:14.738572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:17.234897 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:17.234860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:17.336541 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:17.336503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:21.084894 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:21.084859 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:21.185188 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:21.185159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:29.258896 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:29.258810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:29.809984 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:29.809956 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:31.264880 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.264843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:31.340123 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.340091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:31.412708 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.412661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:31.569842 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.569775 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:38:31.570102 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570091 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="extract" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570105 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="extract" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570116 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="extract" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570122 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="extract" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570131 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="util" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570136 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="util" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570144 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="pull" Jul 14 14:38:31.570149 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570150 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570160 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570165 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570172 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570177 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570182 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570187 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570194 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570199 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570207 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570211 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570217 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570222 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570227 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570232 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="util" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570236 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570241 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="pull" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570295 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc17379-709d-408d-b96f-624c806dac73" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570304 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="234f4fc6-d0c4-4065-a38b-dc7114e958b2" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570311 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b902b9-0360-4f37-8671-1b8345fcd807" containerName="extract" Jul 14 14:38:31.570355 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.570316 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="81f566ef-efb0-4b40-ac3c-34ff044e4d4a" containerName="extract" Jul 14 14:38:31.573324 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.573307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.575537 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.575519 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 14:38:31.575711 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.575673 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6c6jq\"" Jul 14 14:38:31.576329 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.576308 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 14:38:31.576400 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.576319 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 14:38:31.584420 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.584401 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:38:31.606995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.606976 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:38:31.633727 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.633700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrd7\" (UniqueName: \"kubernetes.io/projected/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-kube-api-access-hvrd7\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.633805 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.633752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-config-file\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.734595 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.734569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-config-file\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.734710 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.734624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrd7\" (UniqueName: \"kubernetes.io/projected/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-kube-api-access-hvrd7\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.735166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.735149 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-config-file\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.750524 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.750495 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrd7\" (UniqueName: \"kubernetes.io/projected/ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3-kube-api-access-hvrd7\") pod \"limitador-limitador-54d6d988d5-b4h98\" (UID: \"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:31.884295 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:31.884233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:32.017231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:32.017209 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:38:32.019526 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:38:32.019495 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0a1188_4fe1_4a65_bb22_cfbbadc28cd3.slice/crio-e4e267a758625032a3a42d35fe6b8801774365ed79143739888ebb16e88d63a2 WatchSource:0}: Error finding container e4e267a758625032a3a42d35fe6b8801774365ed79143739888ebb16e88d63a2: Status 404 returned error can't find the container with id e4e267a758625032a3a42d35fe6b8801774365ed79143739888ebb16e88d63a2 Jul 14 14:38:32.075089 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:32.075059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" event={"ID":"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3","Type":"ContainerStarted","Data":"e4e267a758625032a3a42d35fe6b8801774365ed79143739888ebb16e88d63a2"} Jul 14 14:38:32.162797 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:32.162713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:32.553418 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:32.553379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:34.243841 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:34.243800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:34.344793 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:34.344756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:35.092995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:35.092961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" event={"ID":"ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3","Type":"ContainerStarted","Data":"1c7217c9cdab6def983a606e9c17474ad91051376ec1375434a5f282fa9a9e3b"} Jul 14 14:38:35.093207 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:35.093085 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:35.116373 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:35.116333 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" podStartSLOduration=1.41698935 podStartE2EDuration="4.116320312s" totalImagesPullingTime="2.699330962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:38:35.11474596 +0000 UTC m=+451.673935630" watchObservedRunningTime="2026-07-14 14:38:35.116320312 +0000 UTC m=+451.675509966" Jul 14 14:38:45.981167 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:45.981133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:46.081092 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:46.081058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:46.104116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:46.104094 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b4h98" Jul 14 14:38:47.410116 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:47.410082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:47.507613 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:47.507586 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:48.053062 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:48.053015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:38:59.710918 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:38:59.710878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:00.049708 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:00.049641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:07.141636 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:07.141592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:07.211063 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:07.211034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:07.278560 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:07.278526 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:07.502620 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:07.502582 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:08.274072 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:08.274040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:11.169443 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:11.169408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:11.256409 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:11.256376 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:23.657097 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:23.657061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:23.757245 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:23.757214 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:24.228402 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:24.228366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:24.306442 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:24.306409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:24.637267 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:24.637184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:24.738103 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:24.738071 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:24.899812 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:24.899731 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:39:34.725952 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:34.725919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:34.826823 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:34.826792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:44.271202 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:44.271169 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:44.739519 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:44.739486 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:39:51.602540 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:51.602507 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:39:52.234833 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:39:52.234803 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:40:00.791011 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:00.790896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:01.942472 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:01.942436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:40:05.656080 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:05.656045 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:07.145384 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:07.145348 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:40:09.149689 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:09.149636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:09.220909 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:09.220874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:10.156192 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.156159 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c"] Jul 14 14:40:10.158886 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.158864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.161266 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.161237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 14:40:10.161266 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.161244 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tqhk5\"" Jul 14 14:40:10.162055 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.162034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 14:40:10.162170 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.162066 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 14:40:10.174026 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.174002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c"] Jul 14 14:40:10.187594 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.187559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:10.325568 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325543 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.325733 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.325733 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.325733 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9cd4\" (UniqueName: \"kubernetes.io/projected/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-kube-api-access-t9cd4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.325898 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.325898 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.325854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426617 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426617 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426617 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9cd4\" (UniqueName: \"kubernetes.io/projected/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-kube-api-access-t9cd4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.426883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.426769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.427041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.427015 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.427130 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.427114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.427217 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.427190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.429065 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.429037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.429287 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.429270 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.434647 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.434628 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9cd4\" (UniqueName: \"kubernetes.io/projected/9b350e41-28f9-4b6e-a17e-d92a87fad3dd-kube-api-access-t9cd4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6c4c\" (UID: \"9b350e41-28f9-4b6e-a17e-d92a87fad3dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.468815 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.468792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:10.599191 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:10.599169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c"] Jul 14 14:40:10.601078 ip-10-0-135-215 kubenswrapper[2562]: W0714 14:40:10.601052 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b350e41_28f9_4b6e_a17e_d92a87fad3dd.slice/crio-289ce8c5678e3ec6cf65ca94d9d4aaf6957101a77f0110823c7dfc35c7cfdad1 WatchSource:0}: Error finding container 289ce8c5678e3ec6cf65ca94d9d4aaf6957101a77f0110823c7dfc35c7cfdad1: Status 404 returned error can't find the container with id 289ce8c5678e3ec6cf65ca94d9d4aaf6957101a77f0110823c7dfc35c7cfdad1 Jul 14 14:40:11.578732 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:11.578692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" event={"ID":"9b350e41-28f9-4b6e-a17e-d92a87fad3dd","Type":"ContainerStarted","Data":"289ce8c5678e3ec6cf65ca94d9d4aaf6957101a77f0110823c7dfc35c7cfdad1"} Jul 14 14:40:12.585793 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:12.585756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" event={"ID":"9b350e41-28f9-4b6e-a17e-d92a87fad3dd","Type":"ContainerStarted","Data":"02829a3ff7a4bf1bcd7d16d4918811be27811e447d5fb08b3a1d5a53d882ce6f"} Jul 14 14:40:12.607270 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:12.607219 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" podStartSLOduration=1.484338792 podStartE2EDuration="2.607203513s" totalImagesPullingTime="1.122864721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 14:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 14:40:12.60484854 +0000 UTC m=+549.164038203" watchObservedRunningTime="2026-07-14 14:40:12.607203513 +0000 UTC m=+549.166393167" Jul 14 14:40:17.288407 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:17.288369 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:40:17.634269 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:17.634190 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:40:20.469451 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:20.469413 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:20.469978 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:20.469485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:20.482591 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:20.482564 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:20.636722 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:20.636696 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6c4c" Jul 14 14:40:24.839612 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:40:24.839572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:41:03.845183 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:03.845155 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:41:03.847096 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:03.847070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:41:03.851404 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:03.851382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:41:03.853845 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:03.853827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:41:15.242870 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:15.242831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:41:17.010227 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:17.010179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:41:41.561811 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:41.561718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:41:46.848897 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:46.848857 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:41:56.532315 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:41:56.532283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:42:07.636139 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:07.636108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:42:15.639706 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:15.639653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:42:26.636862 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:26.636828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:42:28.885246 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:28.885205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:42:30.863971 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:30.863938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:42:32.626756 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:32.626723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:42:50.204885 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:50.204847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:42:50.265459 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:50.265429 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:42:55.438442 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:42:55.438368 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:43:07.869452 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:07.869413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:09.035515 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:09.035478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:43:11.857371 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:11.857327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:11.962128 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:11.962088 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:12.082100 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:12.082060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:17.723451 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:17.723405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:17.831143 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:17.831110 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:17.924134 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:17.924103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:18.099643 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:18.099526 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:23.996512 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:23.996486 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:24.096416 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:24.096391 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:43:41.430209 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:41.430176 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:43:52.234480 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:43:52.234450 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:01.437814 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:01.437779 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:10.939067 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:10.939024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:23.341605 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:23.341570 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:33.039890 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:33.039809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:43.938041 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:43.938007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:44:54.042814 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:44:54.042780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:45:19.343058 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:19.343025 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:45:22.322973 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:22.322935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:45:22.378698 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:22.378650 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:45:30.738900 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:30.738868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:45:50.223273 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:50.223229 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:45:52.046465 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:45:52.046435 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:46:03.879807 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:03.879721 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:46:03.882883 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:03.882855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:46:03.887232 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:03.887212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:46:03.890029 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:03.890014 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:46:05.131803 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:05.131771 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:46:21.235065 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:21.235032 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:46:32.049570 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:32.049540 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:46:41.834809 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:41.834773 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:46:51.640505 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:46:51.640473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:47:00.832498 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:47:00.832460 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:47:03.688796 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:47:03.688745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:47:05.227403 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:47:05.227372 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:48:47.240563 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:48:47.240533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:48:59.139121 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:48:59.139039 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:49:10.942979 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:49:10.942938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:49:24.050214 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:49:24.050181 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:49:33.444463 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:49:33.444430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:49:44.437303 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:49:44.437268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:49:52.645438 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:49:52.645405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:50:02.705649 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:02.705584 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:50:04.034815 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:04.034776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:50:16.150716 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:16.150673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:50:24.642387 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:24.642303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:50:35.550742 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:35.550707 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:50:39.407255 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:39.407211 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:50:57.542364 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:50:57.542327 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:51:03.912936 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:03.912907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:51:03.916745 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:03.916723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:51:03.919180 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:03.919154 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:51:03.923088 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:03.923070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:51:07.460783 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:07.460751 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:51:18.642995 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:18.642962 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:51:26.466908 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:26.466875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:51:38.439107 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:38.439076 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:51:57.347433 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:51:57.347358 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:52:09.445655 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:09.445623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:52:14.183194 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:14.183159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:52:18.536750 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:18.536709 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:52:32.042932 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:32.042901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:52:41.338454 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:41.338420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:52:54.848094 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:52:54.848052 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:04.348930 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:04.348889 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:14.245772 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:14.245737 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:24.139117 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:24.139084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:37.637823 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:37.637792 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:46.346765 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:46.346736 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:53:58.341927 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:53:58.341892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:54:10.039395 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:10.039353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:54:21.739741 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:21.739701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:54:24.783480 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:24.783450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:30.839402 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:30.839364 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:54:34.360052 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:34.360017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:42.639054 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:42.639017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:47.813461 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:47.813412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:48.510073 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:48.510041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:50.896231 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:50.896196 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:50.987881 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:50.987846 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:51.351272 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:51.351234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:51.738640 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:51.738604 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:54:57.212787 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:57.212701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:57.387652 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:57.387617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:57.479383 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:57.479337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:57.574737 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:57.574672 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:58.633718 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:58.633667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:58.726212 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:58.726179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:58.805127 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:58.805091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:59.208473 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:59.208440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:59.370092 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:59.370065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:54:59.471717 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:54:59.471608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:55:01.487280 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:55:01.487250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:55:02.338523 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:55:02.338493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:56:03.947858 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:03.947826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:56:03.955195 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:03.955173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:56:03.961403 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:03.961379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 14:56:03.968196 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:03.968180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 14:56:15.034195 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:15.034128 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:17.055234 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:17.055198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:56:18.828465 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:18.828435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:24.856665 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:24.856544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:24.928528 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:24.928493 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:29.019664 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:29.019634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:29.392487 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:29.392396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:29.485211 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:29.485179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:29.582940 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:29.582907 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:30.812120 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:30.812086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:30.930183 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:30.930151 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:31.032673 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:31.032631 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:31.434277 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:31.434247 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:31.534762 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:31.534724 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:39.436929 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:39.436893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:56:50.639946 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:50.639913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:50.705492 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:50.705459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:54.002350 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:54.002314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:56:56.970783 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:56:56.970745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:35.486201 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:35.486168 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:36.912093 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:36.912055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:38.147166 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:38.147135 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:57:41.627742 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:41.627706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:41.727565 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:41.727535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:41.828340 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:41.828277 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:47.399239 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:47.399206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:47.475825 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:47.475794 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:47.631344 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:47.631313 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:47.714281 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:47.714206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:48.924092 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:48.924054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:49.030205 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:49.030176 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:49.520228 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:49.520194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:49.619385 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:49.619346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:49.722374 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:49.722334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:50.605372 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:50.605325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:52.942997 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:52.942970 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:57:54.110611 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:54.110576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:54.212274 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:54.212231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:54.920916 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:54.920889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:57:55.021145 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:57:55.021117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:58:11.311834 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:58:11.311777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:58:54.346298 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:58:54.346256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:58:57.140478 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:58:57.140452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:58:59.046901 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:58:59.046864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:04.939876 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:04.939838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:05.041127 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:05.041098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:09.968791 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:09.968754 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:10.342435 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:10.342404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:11.475718 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:11.475662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:11.581186 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:11.581151 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:11.732712 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:11.732599 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:12.001391 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:12.001310 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:12.219159 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:12.219110 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:12.316856 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:12.316741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:20.652687 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:20.652656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 14:59:26.637514 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:26.637478 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:26.712322 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:26.712282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 14:59:30.080587 ip-10-0-135-215 kubenswrapper[2562]: I0714 14:59:30.080560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:16.313802 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:16.313770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:19.239652 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:19.239615 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:00:21.788978 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:21.788940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:27.099523 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:27.099476 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:27.199799 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:27.199760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:31.117804 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:31.117749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:31.665085 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:31.665042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:31.767463 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:31.767433 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:31.868758 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:31.868732 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:33.376287 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:33.376238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:37.556101 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:37.556071 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:39.291104 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:39.291060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:39.356846 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:39.356819 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:39.504220 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:39.504186 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:39.601528 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:39.601445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:00:40.012345 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:00:40.012315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:03.983954 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:03.983919 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:01:03.990381 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:03.990360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:01:03.997420 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:03.997403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:01:04.003734 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:04.003717 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:01:06.000128 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:06.000059 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:11.895926 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:11.895827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:12.075604 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:12.075541 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:12.176609 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:12.176535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:28.011618 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:28.011587 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:34.023188 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:34.023146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:34.116957 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:34.116902 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:44.614376 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:44.614339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:45.377162 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:45.377123 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:51.397648 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:51.397611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:51.526370 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:51.526334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:51.623712 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:51.623647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:51.723213 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:51.723181 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:52.548579 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:52.548551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:52.646901 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:52.646872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:01:53.841099 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:53.841070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:01:54.363599 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:01:54.363565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:00.605141 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:00.605094 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:00.699295 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:00.699254 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:01.114127 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:01.114087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:01.339462 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:01.339429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:02:07.381527 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:07.381496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:07.486844 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:07.486811 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:07.590693 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:07.590640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:07.930329 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:07.930295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:08.125776 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:08.125743 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:09.835943 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:09.835906 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:02:11.231502 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:11.231456 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:11.332295 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:11.332261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:11.505289 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:11.505189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:11.883736 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:11.883620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:12.163228 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:12.163129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:12.262017 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:12.261984 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:15.706477 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:15.706441 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:16.333805 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:16.333775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:16.430609 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:16.430542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:16.727583 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:16.727552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:20.352052 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:20.352019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:02:22.593928 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:22.593894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:22.689535 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:22.689497 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:33.440927 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:33.440845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:36.437767 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:36.437733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:02:38.104367 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:38.104334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:43.928930 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:43.928900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:44.029121 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:44.029095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:48.698769 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:48.698733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:48.915670 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:48.915638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:49.088418 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:49.088388 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:49.188976 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:49.188948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:49.288908 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:49.288873 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:54.938119 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:54.938089 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:55.037732 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:55.037703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:55.323922 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:55.323889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:55.437936 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:55.437904 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:55.525076 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:55.525035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:02:56.040994 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:02:56.040967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:01.373745 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:01.373717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:01.474559 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:01.474529 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:08.151600 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:08.151564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:08.511374 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:08.511340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:08.862156 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:08.862076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:11.620276 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:11.620225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:11.730090 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:11.730057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:11.821034 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:11.820997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:12.507161 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:12.507114 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:12.707565 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:12.707531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:12.822046 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:12.821975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:16.064743 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:16.064713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:16.846067 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:16.846037 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:03:32.804029 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:32.803998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:35.740896 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:35.740862 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:03:44.217691 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:44.217655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:44.279585 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:44.279555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:55.162957 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:55.162876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:03:55.941778 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:55.941745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:03:59.382808 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.382779 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5"] Jul 14 15:03:59.386217 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.386201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:03:59.388583 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.388554 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:03:59.388725 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.388613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5695q\"" Jul 14 15:03:59.396338 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.396316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5"] Jul 14 15:03:59.471857 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.471836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5\" (UID: \"ad2951bc-5868-48a8-8a0f-8cc567acbde6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:03:59.572492 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.572458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5\" (UID: \"ad2951bc-5868-48a8-8a0f-8cc567acbde6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:03:59.573069 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.573050 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5\" (UID: \"ad2951bc-5868-48a8-8a0f-8cc567acbde6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:03:59.698471 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.698411 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:03:59.829034 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.826492 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5"] Jul 14 15:03:59.829894 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:03:59.829867 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2951bc_5868_48a8_8a0f_8cc567acbde6.slice/crio-b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624 WatchSource:0}: Error finding container b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624: Status 404 returned error can't find the container with id b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624 Jul 14 15:03:59.831829 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:03:59.831811 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 15:04:00.631196 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:00.631156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" event={"ID":"ad2951bc-5868-48a8-8a0f-8cc567acbde6","Type":"ContainerStarted","Data":"b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624"} Jul 14 15:04:02.644538 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:02.644498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" event={"ID":"ad2951bc-5868-48a8-8a0f-8cc567acbde6","Type":"ContainerStarted","Data":"74e95e9ebd9fc870ae7bac38640f20feb223d9977068ec9e6c4f06f1bf4326c8"} Jul 14 15:04:02.660743 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:02.660698 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" podStartSLOduration=1.555275451 podStartE2EDuration="3.660662886s" totalImagesPullingTime="2.105387435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:04:02.659103288 +0000 UTC m=+1979.218292943" watchObservedRunningTime="2026-07-14 15:04:02.660662886 +0000 UTC m=+1979.219852541" Jul 14 15:04:03.651173 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:03.651139 2562 generic.go:356] "Generic (PLEG): container finished" podID="ad2951bc-5868-48a8-8a0f-8cc567acbde6" containerID="74e95e9ebd9fc870ae7bac38640f20feb223d9977068ec9e6c4f06f1bf4326c8" exitCode=0 Jul 14 15:04:03.651576 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:03.651190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" event={"ID":"ad2951bc-5868-48a8-8a0f-8cc567acbde6","Type":"ContainerDied","Data":"74e95e9ebd9fc870ae7bac38640f20feb223d9977068ec9e6c4f06f1bf4326c8"} Jul 14 15:04:04.792015 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:04.791983 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:04:04.919029 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:04.918932 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca\") pod \"ad2951bc-5868-48a8-8a0f-8cc567acbde6\" (UID: \"ad2951bc-5868-48a8-8a0f-8cc567acbde6\") " Jul 14 15:04:04.919249 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:04.919227 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ad2951bc-5868-48a8-8a0f-8cc567acbde6" (UID: "ad2951bc-5868-48a8-8a0f-8cc567acbde6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:04:05.019968 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:05.019937 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad2951bc-5868-48a8-8a0f-8cc567acbde6-maas-api-service-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:04:05.661929 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:05.661891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" event={"ID":"ad2951bc-5868-48a8-8a0f-8cc567acbde6","Type":"ContainerDied","Data":"b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624"} Jul 14 15:04:05.661929 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:05.661928 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5" Jul 14 15:04:05.662156 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:05.661947 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b02a082819a2d0a52dea89d497bd43ce01a7f4a45a5cd5c9e1c15e72af3f8624" Jul 14 15:04:09.884047 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:09.884016 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:04:13.690302 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:13.690268 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:04:14.489662 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:14.489629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:04:19.563251 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:19.563191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:04:55.993430 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:55.993371 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:04:57.058552 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:04:57.058513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:03.124100 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:03.124066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:03.204057 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:03.204030 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:06.764209 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:06.764169 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:07.019204 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:07.019117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:08.039381 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:08.039332 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:08.136169 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:08.136130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:08.235641 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:08.235604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:08.994302 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:08.994270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:09.093867 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:09.093837 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:09.191222 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:09.191184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:09.952030 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:09.951995 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:05:10.553237 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:10.553198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:16.397391 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:16.397356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:16.476198 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:16.476168 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:17.087257 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:17.087226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:23.006660 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:23.006621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:23.109264 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:23.109220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:23.212635 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:23.212581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:24.553596 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:24.553517 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:05:33.763371 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:33.763333 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:34.129531 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:34.129441 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:53.844252 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:53.844209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:05:55.103571 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:05:55.103495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:01.114800 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:01.114771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:01.188635 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:01.188597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:01.519484 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:01.519453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:01.845745 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:01.845638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:02.289844 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:02.289812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:04.016118 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.016092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:06:04.022106 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.022086 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:06:04.030549 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.030532 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:06:04.036783 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.036762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:06:04.468965 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.468891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:04.557869 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.557833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:04.661131 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.661106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:04.771584 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:04.771555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:05.193871 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:05.193784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:05.294184 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:05.293637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:08.966368 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:08.966334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:09.694735 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:09.694674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:09.760986 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:09.760955 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:10.317529 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:10.317489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:11.739835 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:11.739802 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:06:12.506197 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:12.506164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:12.938255 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:12.938173 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:13.040780 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:13.040751 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:13.183645 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:13.183609 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:13.303420 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:13.303386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:17.048844 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:17.048810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:22.872492 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:22.872454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:06:26.978501 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:26.978396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:27.553625 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:27.553588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:30.520387 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:30.520353 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:34.295074 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:34.295039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:34.394781 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:34.394729 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:35.739355 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:35.739311 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:06:48.441380 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:48.441330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:55.347521 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:55.347442 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:06:57.225036 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:57.225004 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:06:57.326429 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:06:57.326386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:10.548521 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:10.548484 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:11.666429 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.666390 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp"] Jul 14 15:07:11.666946 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.666896 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad2951bc-5868-48a8-8a0f-8cc567acbde6" containerName="revoke-keys" Jul 14 15:07:11.666946 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.666914 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad2951bc-5868-48a8-8a0f-8cc567acbde6" containerName="revoke-keys" Jul 14 15:07:11.667063 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.667017 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad2951bc-5868-48a8-8a0f-8cc567acbde6" containerName="revoke-keys" Jul 14 15:07:11.669020 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.668999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:11.671262 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.671243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:07:11.671383 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.671340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5695q\"" Jul 14 15:07:11.677709 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.677662 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp"] Jul 14 15:07:11.727628 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.727598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp\" (UID: \"be42f547-76ac-487b-be83-5388ca56af6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:11.829204 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.829171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp\" (UID: \"be42f547-76ac-487b-be83-5388ca56af6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:11.829868 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.829847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp\" (UID: \"be42f547-76ac-487b-be83-5388ca56af6c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:11.937601 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.937505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:11.981825 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:11.981800 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:12.127532 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.127344 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp"] Jul 14 15:07:12.130491 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:07:12.130465 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe42f547_76ac_487b_be83_5388ca56af6c.slice/crio-026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472 WatchSource:0}: Error finding container 026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472: Status 404 returned error can't find the container with id 026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472 Jul 14 15:07:12.218226 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.218151 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:12.319504 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.319473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:12.593757 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.593720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" event={"ID":"be42f547-76ac-487b-be83-5388ca56af6c","Type":"ContainerStarted","Data":"9ecff4d3b348f2b627e6878710d09d18873662486d8e60d8755e63e1f8510542"} Jul 14 15:07:12.593956 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.593788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" event={"ID":"be42f547-76ac-487b-be83-5388ca56af6c","Type":"ContainerStarted","Data":"026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472"} Jul 14 15:07:12.611322 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:12.611277 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" podStartSLOduration=1.611256246 podStartE2EDuration="1.611256246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:07:12.609580564 +0000 UTC m=+2169.168770241" watchObservedRunningTime="2026-07-14 15:07:12.611256246 +0000 UTC m=+2169.170445917" Jul 14 15:07:13.600624 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:13.600587 2562 generic.go:356] "Generic (PLEG): container finished" podID="be42f547-76ac-487b-be83-5388ca56af6c" containerID="9ecff4d3b348f2b627e6878710d09d18873662486d8e60d8755e63e1f8510542" exitCode=0 Jul 14 15:07:13.601042 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:13.600702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" event={"ID":"be42f547-76ac-487b-be83-5388ca56af6c","Type":"ContainerDied","Data":"9ecff4d3b348f2b627e6878710d09d18873662486d8e60d8755e63e1f8510542"} Jul 14 15:07:14.737026 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:14.736999 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:14.853528 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:14.853493 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca\") pod \"be42f547-76ac-487b-be83-5388ca56af6c\" (UID: \"be42f547-76ac-487b-be83-5388ca56af6c\") " Jul 14 15:07:14.853891 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:14.853869 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be42f547-76ac-487b-be83-5388ca56af6c" (UID: "be42f547-76ac-487b-be83-5388ca56af6c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:07:14.954850 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:14.954767 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be42f547-76ac-487b-be83-5388ca56af6c-maas-api-service-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:07:15.612153 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:15.612126 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" Jul 14 15:07:15.612345 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:15.612161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp" event={"ID":"be42f547-76ac-487b-be83-5388ca56af6c","Type":"ContainerDied","Data":"026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472"} Jul 14 15:07:15.612345 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:15.612215 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="026bea9fba68d6f5b7fc155dcfd0e659b4a68b286ca62288f5369611bcb85472" Jul 14 15:07:17.082328 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:17.082296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:07:22.625878 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:22.625848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:26.770601 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:26.770567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:27.544283 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:27.544253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:07:33.176427 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:33.176396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:33.273449 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:33.273394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:37.477327 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:37.477273 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:37.735985 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:37.735891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:38.464474 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:38.464431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:38.569094 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:38.569061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:48.404917 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:48.404876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:51.867197 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:51.867165 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:07:54.139223 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:54.139181 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:55.777253 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:55.777215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:55.922155 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:55.922124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:59.554200 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:59.554169 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:07:59.657202 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:07:59.657165 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:03.732513 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:03.732460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:03.943879 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:03.943850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:04.361703 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:04.361647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:04.734660 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:04.734621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:05.096019 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:05.095924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:08.183952 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:08.183912 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:08.276129 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:08.276096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:08.408106 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:08.408076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:08.555649 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:08.555615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:09.058906 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:09.058876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:09.160331 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:09.160294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:12.889596 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:12.889561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:12.939864 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:12.939831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:08:13.804010 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:13.803980 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:14.295079 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:14.295048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:14.493976 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:14.493945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:14.595502 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:14.595420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:17.597436 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:17.597404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:17.704776 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:17.704743 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:17.865089 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:17.864998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:18.006653 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:18.006619 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:18.392607 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:18.392572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:18.494075 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:18.494043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:22.222821 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:22.222778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:25.864492 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:25.864407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:08:29.910064 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:29.910026 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:30.010534 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.010503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:30.558717 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.558670 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv"] Jul 14 15:08:30.559021 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.559009 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be42f547-76ac-487b-be83-5388ca56af6c" containerName="revoke-keys" Jul 14 15:08:30.559070 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.559023 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be42f547-76ac-487b-be83-5388ca56af6c" containerName="revoke-keys" Jul 14 15:08:30.559105 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.559088 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be42f547-76ac-487b-be83-5388ca56af6c" containerName="revoke-keys" Jul 14 15:08:30.561252 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.561235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:30.563427 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.563409 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:08:30.563562 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.563496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5695q\"" Jul 14 15:08:30.572012 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.571988 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv"] Jul 14 15:08:30.706499 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.706464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv\" (UID: \"2bf93213-724d-42f3-a7fd-4dd9e9097387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:30.807388 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.807355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv\" (UID: \"2bf93213-724d-42f3-a7fd-4dd9e9097387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:30.807978 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.807959 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv\" (UID: \"2bf93213-724d-42f3-a7fd-4dd9e9097387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:30.873026 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:30.872938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:31.007028 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:31.006995 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv"] Jul 14 15:08:31.010441 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:08:31.010417 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf93213_724d_42f3_a7fd_4dd9e9097387.slice/crio-e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2 WatchSource:0}: Error finding container e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2: Status 404 returned error can't find the container with id e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2 Jul 14 15:08:32.005300 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:32.005266 2562 generic.go:356] "Generic (PLEG): container finished" podID="2bf93213-724d-42f3-a7fd-4dd9e9097387" containerID="dd27f2164d0b54c9df47c593793c591ad30c80effc6901bb44414e99d37d55a2" exitCode=0 Jul 14 15:08:32.005506 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:32.005348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" event={"ID":"2bf93213-724d-42f3-a7fd-4dd9e9097387","Type":"ContainerDied","Data":"dd27f2164d0b54c9df47c593793c591ad30c80effc6901bb44414e99d37d55a2"} Jul 14 15:08:32.005506 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:32.005394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" event={"ID":"2bf93213-724d-42f3-a7fd-4dd9e9097387","Type":"ContainerStarted","Data":"e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2"} Jul 14 15:08:33.148877 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:33.148854 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:33.329814 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:33.329730 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca\") pod \"2bf93213-724d-42f3-a7fd-4dd9e9097387\" (UID: \"2bf93213-724d-42f3-a7fd-4dd9e9097387\") " Jul 14 15:08:33.330099 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:33.330077 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2bf93213-724d-42f3-a7fd-4dd9e9097387" (UID: "2bf93213-724d-42f3-a7fd-4dd9e9097387"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:08:33.430913 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:33.430873 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf93213-724d-42f3-a7fd-4dd9e9097387-maas-api-service-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:08:34.016282 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:34.016258 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" Jul 14 15:08:34.016425 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:34.016250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv" event={"ID":"2bf93213-724d-42f3-a7fd-4dd9e9097387","Type":"ContainerDied","Data":"e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2"} Jul 14 15:08:34.016425 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:34.016381 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e769444c47a90ff9d55e550d1a50e9ff79b33143a76c7a806770a4be13f1b6a2" Jul 14 15:08:40.604227 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:40.604196 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:40.702484 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:40.702444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:40.914631 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:40.914523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:44.849497 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:44.849457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:08:45.740778 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:45.740744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:51.799169 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:51.799134 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:51.901167 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:51.901131 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:56.439918 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:56.439845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:08:56.688320 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:08:56.688267 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:07.504731 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:07.504699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:10.647529 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:10.647487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:09:11.921473 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:11.921438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:18.421146 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:18.421113 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:18.495345 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:18.495312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:22.651285 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:22.651252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:22.865037 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:22.865008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:23.238435 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:23.238404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:23.555266 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:23.555178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:23.794732 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:23.794698 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:26.583619 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:26.583582 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:26.755558 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:26.755523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:26.849562 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:26.849479 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:27.154939 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:27.154842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:27.302979 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:27.302930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:29.769500 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:29.769460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:31.043503 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:31.043474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:09:31.072165 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:31.072119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:31.425095 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:31.425007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:31.754153 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:31.754119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:32.037137 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:32.037042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:34.601082 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:34.601049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:34.716191 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:34.716143 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:34.846140 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:34.846106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:34.953474 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:34.953381 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:35.352415 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:35.352374 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:37.563832 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:37.563798 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:39.089819 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:39.089769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:40.005572 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:40.005541 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:09:48.177430 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:48.177390 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:48.273823 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:48.273788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:56.243815 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:56.243735 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:56.351422 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:56.351392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:09:59.566529 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:09:59.566494 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:10:03.035231 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:03.035197 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:10:18.609253 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:18.609211 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:10:20.681536 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:20.681501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:10:22.050120 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:22.050089 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:10:36.248656 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:36.248620 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:10:54.842862 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:10:54.842830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:11:04.059735 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:04.059710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:11:04.065671 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:04.065650 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:11:04.067428 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:04.067409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:11:04.073505 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:04.073487 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:11:14.231312 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:14.231272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:11:28.440505 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:28.440429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:11:32.357164 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:32.357127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:11:44.044165 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:11:44.044132 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:12:03.348218 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:03.348188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:12:16.980086 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:16.980044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:17.988545 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:17.988511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:22.245155 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:22.245125 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:12:27.567590 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.567557 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:12:27.568098 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.568081 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf93213-724d-42f3-a7fd-4dd9e9097387" containerName="revoke-keys" Jul 14 15:12:27.568142 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.568101 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf93213-724d-42f3-a7fd-4dd9e9097387" containerName="revoke-keys" Jul 14 15:12:27.568188 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.568177 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf93213-724d-42f3-a7fd-4dd9e9097387" containerName="revoke-keys" Jul 14 15:12:27.571948 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.571926 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.575312 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.575279 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ebb1a4\"/\"kube-root-ca.crt\"" Jul 14 15:12:27.575312 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.575285 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ebb1a4\"/\"openshift-service-ca.crt\"" Jul 14 15:12:27.575312 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.575312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ebb1a4\"/\"sub-test-model-ebb1a4-kserve-self-signed-certs\"" Jul 14 15:12:27.575564 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.575285 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ebb1a4\"/\"default-dockercfg-dldgp\"" Jul 14 15:12:27.580867 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.580841 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:12:27.644511 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.644483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:27.686433 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94p48\" (UniqueName: \"kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.686574 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.686574 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.686574 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.686917 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.686917 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.686762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.787975 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.787954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788088 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.787981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788088 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788088 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788247 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94p48\" (UniqueName: \"kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788247 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788393 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788371 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788453 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.788504 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.788484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.790622 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.790597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.790790 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.790773 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.797296 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.797275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94p48\" (UniqueName: \"kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48\") pod \"sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:27.882357 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:27.882281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:28.021112 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:28.021088 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:12:28.023088 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:12:28.023063 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9e2dc5_5be2_41c5_baf9_dedc54f77483.slice/crio-80c321c14746ee6b1c3e5ee446cf10b94c1591a94e562f18775909561eb2fb59 WatchSource:0}: Error finding container 80c321c14746ee6b1c3e5ee446cf10b94c1591a94e562f18775909561eb2fb59: Status 404 returned error can't find the container with id 80c321c14746ee6b1c3e5ee446cf10b94c1591a94e562f18775909561eb2fb59 Jul 14 15:12:28.187117 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:28.187041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" event={"ID":"4b9e2dc5-5be2-41c5-baf9-dedc54f77483","Type":"ContainerStarted","Data":"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7"} Jul 14 15:12:28.187117 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:28.187078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" event={"ID":"4b9e2dc5-5be2-41c5-baf9-dedc54f77483","Type":"ContainerStarted","Data":"80c321c14746ee6b1c3e5ee446cf10b94c1591a94e562f18775909561eb2fb59"} Jul 14 15:12:28.206305 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:28.206262 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" podStartSLOduration=1.206247626 podStartE2EDuration="1.206247626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:12:28.203884524 +0000 UTC m=+2484.763074178" watchObservedRunningTime="2026-07-14 15:12:28.206247626 +0000 UTC m=+2484.765437280" Jul 14 15:12:33.683659 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:33.683621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:33.885360 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:33.885324 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:37.883187 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:37.883156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:37.883632 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:37.883208 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:37.895263 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:37.895237 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:38.249014 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:38.248983 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:12:40.941312 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:40.941277 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:12:45.086905 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:45.086877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:47.826348 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:47.826314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:52.151626 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:52.151587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:12:56.639460 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:56.639387 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:12:57.802127 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:12:57.802091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:02.693893 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:02.693853 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:07.045352 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:07.045321 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:13:23.788001 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:23.787968 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:13:23.807415 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:23.807387 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:27.495994 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:27.495961 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:29.447348 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:29.447311 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:13:37.971241 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:37.971207 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:38.808733 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:38.808649 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" podUID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" containerName="main" containerID="cri-o://a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7" gracePeriod=45 Jul 14 15:13:39.065159 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.065089 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:13:39.167079 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167042 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167278 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167104 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167278 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167140 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94p48\" (UniqueName: \"kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167278 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167157 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167278 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167188 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167507 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167329 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache\") pod \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\" (UID: \"4b9e2dc5-5be2-41c5-baf9-dedc54f77483\") " Jul 14 15:13:39.167507 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167430 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home" (OuterVolumeSpecName: "home") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:13:39.167507 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167442 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:13:39.167665 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167567 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:13:39.167779 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167728 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-home\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.167779 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167750 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-model-cache\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.167779 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.167766 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tmp-dir\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.169620 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.169588 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:13:39.169760 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.169621 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm" (OuterVolumeSpecName: "dshm") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:13:39.169760 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.169635 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48" (OuterVolumeSpecName: "kube-api-access-94p48") pod "4b9e2dc5-5be2-41c5-baf9-dedc54f77483" (UID: "4b9e2dc5-5be2-41c5-baf9-dedc54f77483"). InnerVolumeSpecName "kube-api-access-94p48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:13:39.268575 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.268539 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-tls-certs\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.268575 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.268566 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-dshm\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.268575 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.268576 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94p48\" (UniqueName: \"kubernetes.io/projected/4b9e2dc5-5be2-41c5-baf9-dedc54f77483-kube-api-access-94p48\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:13:39.546996 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.546956 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" containerID="a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7" exitCode=0 Jul 14 15:13:39.546996 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.546995 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" Jul 14 15:13:39.547236 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.547047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" event={"ID":"4b9e2dc5-5be2-41c5-baf9-dedc54f77483","Type":"ContainerDied","Data":"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7"} Jul 14 15:13:39.547236 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.547082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm" event={"ID":"4b9e2dc5-5be2-41c5-baf9-dedc54f77483","Type":"ContainerDied","Data":"80c321c14746ee6b1c3e5ee446cf10b94c1591a94e562f18775909561eb2fb59"} Jul 14 15:13:39.547236 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.547098 2562 scope.go:117] "RemoveContainer" containerID="a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7" Jul 14 15:13:39.556451 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.556432 2562 scope.go:117] "RemoveContainer" containerID="a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7" Jul 14 15:13:39.556801 ip-10-0-135-215 kubenswrapper[2562]: E0714 15:13:39.556779 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7\": container with ID starting with a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7 not found: ID does not exist" containerID="a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7" Jul 14 15:13:39.556853 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.556811 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7"} err="failed to get container status \"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7\": rpc error: code = NotFound desc = could not find container \"a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7\": container with ID starting with a2a6648a2cdb6d16bbf06cb40946f5476c223b08233f38254623e0554a9619f7 not found: ID does not exist" Jul 14 15:13:39.573938 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.573912 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:13:39.577943 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.577920 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ebb1a4/sub-test-model-ebb1a4-kserve-867b5bb449-nhvvm"] Jul 14 15:13:39.982693 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:39.982649 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" path="/var/lib/kubelet/pods/4b9e2dc5-5be2-41c5-baf9-dedc54f77483/volumes" Jul 14 15:13:48.350502 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:48.350466 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:13:54.672785 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.672749 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:13:54.673249 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.673077 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" containerName="main" Jul 14 15:13:54.673249 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.673088 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" containerName="main" Jul 14 15:13:54.673249 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.673150 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9e2dc5-5be2-41c5-baf9-dedc54f77483" containerName="main" Jul 14 15:13:54.676200 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.676180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.679814 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.679789 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-747ac7\"/\"kube-root-ca.crt\"" Jul 14 15:13:54.679814 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.679804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-747ac7\"/\"rate-test-model-747ac7-kserve-self-signed-certs\"" Jul 14 15:13:54.679814 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.679789 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-747ac7\"/\"openshift-service-ca.crt\"" Jul 14 15:13:54.680013 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.679830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-747ac7\"/\"default-dockercfg-qkp67\"" Jul 14 15:13:54.690043 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.690014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:13:54.710543 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.710765 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.710765 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.710765 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.710765 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.710994 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.710772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzn5c\" (UniqueName: \"kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.760298 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.760262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:13:54.811647 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.811647 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.811922 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.811922 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.811922 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzn5c\" (UniqueName: \"kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.811922 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.811821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.812136 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.812112 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.812188 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.812173 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.812225 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.812191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.814214 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.814190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.814376 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.814357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.822169 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.822131 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzn5c\" (UniqueName: \"kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c\") pod \"rate-test-model-747ac7-kserve-6bc4f48995-pmdbg\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:54.985581 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:54.985543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:13:55.127518 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:55.127489 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:13:55.129457 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:13:55.129429 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e21f474_76b1_4607_8fd7_bc5c4fa8d23f.slice/crio-1606eec69e901b55ad9179d3a20816cd0d5aecfbb9e115b51da26945cd327fb4 WatchSource:0}: Error finding container 1606eec69e901b55ad9179d3a20816cd0d5aecfbb9e115b51da26945cd327fb4: Status 404 returned error can't find the container with id 1606eec69e901b55ad9179d3a20816cd0d5aecfbb9e115b51da26945cd327fb4 Jul 14 15:13:55.629821 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:55.629787 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" event={"ID":"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f","Type":"ContainerStarted","Data":"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483"} Jul 14 15:13:55.630042 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:55.629833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" event={"ID":"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f","Type":"ContainerStarted","Data":"1606eec69e901b55ad9179d3a20816cd0d5aecfbb9e115b51da26945cd327fb4"} Jul 14 15:13:55.648190 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:55.648130 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" podStartSLOduration=1.648112923 podStartE2EDuration="1.648112923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:13:55.646712324 +0000 UTC m=+2572.205902190" watchObservedRunningTime="2026-07-14 15:13:55.648112923 +0000 UTC m=+2572.207302578" Jul 14 15:13:59.965900 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:13:59.965866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:00.236951 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:00.236915 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:14:04.986760 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:04.986722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:04.987158 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:04.986784 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:04.999287 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:04.999258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:05.689835 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:05.689804 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:14.845246 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:14.845215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:14:31.345378 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:31.345344 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:14:31.446652 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:31.446616 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:39.277238 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:39.277197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:40.257917 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:40.257879 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:14:40.285801 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:40.285764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:45.150343 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:45.150306 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:14:49.122960 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:49.122919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:49.263966 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:49.263940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:55.279035 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.278997 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" podUID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" containerName="main" containerID="cri-o://ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483" gracePeriod=45 Jul 14 15:14:55.536477 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.536423 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:55.636170 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636137 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636367 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636175 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636367 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636266 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzn5c\" (UniqueName: \"kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636367 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636295 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636367 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636349 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636609 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636389 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache\") pod \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\" (UID: \"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f\") " Jul 14 15:14:55.636609 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636423 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:14:55.636745 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636637 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home" (OuterVolumeSpecName: "home") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:14:55.636745 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636660 2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tmp-dir\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.636855 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.636739 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:14:55.638668 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.638649 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm" (OuterVolumeSpecName: "dshm") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 15:14:55.638668 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.638659 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 15:14:55.638840 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.638769 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c" (OuterVolumeSpecName: "kube-api-access-qzn5c") pod "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" (UID: "2e21f474-76b1-4607-8fd7-bc5c4fa8d23f"). InnerVolumeSpecName "kube-api-access-qzn5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 15:14:55.737517 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.737489 2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-home\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.737517 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.737511 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-model-cache\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.737517 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.737522 2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-dshm\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.737764 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.737531 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzn5c\" (UniqueName: \"kubernetes.io/projected/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-kube-api-access-qzn5c\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.737764 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.737539 2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f-tls-certs\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:14:55.938461 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.938378 2562 generic.go:356] "Generic (PLEG): container finished" podID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" containerID="ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483" exitCode=0 Jul 14 15:14:55.938461 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.938431 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" Jul 14 15:14:55.938646 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.938470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" event={"ID":"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f","Type":"ContainerDied","Data":"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483"} Jul 14 15:14:55.938646 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.938519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg" event={"ID":"2e21f474-76b1-4607-8fd7-bc5c4fa8d23f","Type":"ContainerDied","Data":"1606eec69e901b55ad9179d3a20816cd0d5aecfbb9e115b51da26945cd327fb4"} Jul 14 15:14:55.938646 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.938542 2562 scope.go:117] "RemoveContainer" containerID="ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483" Jul 14 15:14:55.948584 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.948565 2562 scope.go:117] "RemoveContainer" containerID="ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483" Jul 14 15:14:55.948824 ip-10-0-135-215 kubenswrapper[2562]: E0714 15:14:55.948808 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483\": container with ID starting with ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483 not found: ID does not exist" containerID="ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483" Jul 14 15:14:55.948885 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.948834 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483"} err="failed to get container status \"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483\": rpc error: code = NotFound desc = could not find container \"ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483\": container with ID starting with ea77501d9ab8ab8116a64bef53a6932a89a0a31c00a30c21c20b856b6dd34483 not found: ID does not exist" Jul 14 15:14:55.963086 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.963062 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:14:55.967810 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.967789 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-747ac7/rate-test-model-747ac7-kserve-6bc4f48995-pmdbg"] Jul 14 15:14:55.983663 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:55.983641 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" path="/var/lib/kubelet/pods/2e21f474-76b1-4607-8fd7-bc5c4fa8d23f/volumes" Jul 14 15:14:57.151110 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:57.151064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:14:57.254020 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:14:57.253986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:00.144409 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.144371 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw"] Jul 14 15:15:00.144907 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.144730 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" containerName="main" Jul 14 15:15:00.144907 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.144745 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" containerName="main" Jul 14 15:15:00.144907 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.144834 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e21f474-76b1-4607-8fd7-bc5c4fa8d23f" containerName="main" Jul 14 15:15:00.149127 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.149096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" Jul 14 15:15:00.151601 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.151577 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5695q\"" Jul 14 15:15:00.152143 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.152127 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9"] Jul 14 15:15:00.155611 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.155589 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb"] Jul 14 15:15:00.155760 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.155717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" Jul 14 15:15:00.159096 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.159074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw"] Jul 14 15:15:00.159221 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.159182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" Jul 14 15:15:00.162497 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.162470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" Jul 14 15:15:00.164756 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.164732 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9"] Jul 14 15:15:00.168806 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.167819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb"] Jul 14 15:15:00.174152 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.174135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" Jul 14 15:15:00.205082 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.204928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" Jul 14 15:15:00.335877 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.335848 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw"] Jul 14 15:15:00.337336 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:15:00.337303 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17df9e9_f1c2_4581_929e_fbc18b636095.slice/crio-9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93 WatchSource:0}: Error finding container 9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93: Status 404 returned error can't find the container with id 9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93 Jul 14 15:15:00.380182 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.380157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb"] Jul 14 15:15:00.382005 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:15:00.381976 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585bf67c_51a3_4519_8c6b_1a67bad9e968.slice/crio-04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec WatchSource:0}: Error finding container 04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec: Status 404 returned error can't find the container with id 04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec Jul 14 15:15:00.562328 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.562307 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9"] Jul 14 15:15:00.567769 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:15:00.567736 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a900cf0_1ca9_4c5b_bd6c_c21ed5220343.slice/crio-de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe WatchSource:0}: Error finding container de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe: Status 404 returned error can't find the container with id de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe Jul 14 15:15:00.851727 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.851693 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf"] Jul 14 15:15:00.855489 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.855473 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:00.857897 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.857869 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:15:00.864577 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.864491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf"] Jul 14 15:15:00.977792 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.977752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" event={"ID":"585bf67c-51a3-4519-8c6b-1a67bad9e968","Type":"ContainerStarted","Data":"7307e68b5d4d432b8416b2f3d06239379d801cffd232f651497453a7dff4cb25"} Jul 14 15:15:00.978003 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.977842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" event={"ID":"585bf67c-51a3-4519-8c6b-1a67bad9e968","Type":"ContainerStarted","Data":"04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec"} Jul 14 15:15:00.979496 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.979469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" event={"ID":"e17df9e9-f1c2-4581-929e-fbc18b636095","Type":"ContainerStarted","Data":"84dc564937b7e4ef10f8702f7bfdc115bb66a8ee8643bce777bfc2d44ab1df29"} Jul 14 15:15:00.979630 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.979510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" event={"ID":"e17df9e9-f1c2-4581-929e-fbc18b636095","Type":"ContainerStarted","Data":"9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93"} Jul 14 15:15:00.980957 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.980933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" event={"ID":"4a900cf0-1ca9-4c5b-bd6c-c21ed5220343","Type":"ContainerStarted","Data":"d01c49d7410ebccaa60cb098ae71dbfa6185efccaf56014ea14f293f065ab8b5"} Jul 14 15:15:00.981075 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.980973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" event={"ID":"4a900cf0-1ca9-4c5b-bd6c-c21ed5220343","Type":"ContainerStarted","Data":"de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe"} Jul 14 15:15:00.982435 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:00.982414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf\" (UID: \"3995f58f-43df-4803-975d-08dc5534b1b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:01.003658 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.003606 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" podStartSLOduration=1.003590808 podStartE2EDuration="1.003590808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:01.000923167 +0000 UTC m=+2637.560112824" watchObservedRunningTime="2026-07-14 15:15:01.003590808 +0000 UTC m=+2637.562780463" Jul 14 15:15:01.022215 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.022168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" podStartSLOduration=1.022152975 podStartE2EDuration="1.022152975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:01.019183745 +0000 UTC m=+2637.578373396" watchObservedRunningTime="2026-07-14 15:15:01.022152975 +0000 UTC m=+2637.581342629" Jul 14 15:15:01.037628 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.037578 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" podStartSLOduration=1.037561054 podStartE2EDuration="1.037561054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:01.035658432 +0000 UTC m=+2637.594848109" watchObservedRunningTime="2026-07-14 15:15:01.037561054 +0000 UTC m=+2637.596750709" Jul 14 15:15:01.083946 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.083908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf\" (UID: \"3995f58f-43df-4803-975d-08dc5534b1b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:01.084545 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.084524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf\" (UID: \"3995f58f-43df-4803-975d-08dc5534b1b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:01.167966 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.167931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:01.307089 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.307055 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf"] Jul 14 15:15:01.309240 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:15:01.309216 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3995f58f_43df_4803_975d_08dc5534b1b6.slice/crio-d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe WatchSource:0}: Error finding container d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe: Status 404 returned error can't find the container with id d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe Jul 14 15:15:01.414870 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.414841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:01.514662 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.514579 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:01.986844 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.986815 2562 generic.go:356] "Generic (PLEG): container finished" podID="e17df9e9-f1c2-4581-929e-fbc18b636095" containerID="84dc564937b7e4ef10f8702f7bfdc115bb66a8ee8643bce777bfc2d44ab1df29" exitCode=0 Jul 14 15:15:01.987014 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.986893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" event={"ID":"e17df9e9-f1c2-4581-929e-fbc18b636095","Type":"ContainerDied","Data":"84dc564937b7e4ef10f8702f7bfdc115bb66a8ee8643bce777bfc2d44ab1df29"} Jul 14 15:15:01.988404 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.988373 2562 generic.go:356] "Generic (PLEG): container finished" podID="4a900cf0-1ca9-4c5b-bd6c-c21ed5220343" containerID="d01c49d7410ebccaa60cb098ae71dbfa6185efccaf56014ea14f293f065ab8b5" exitCode=0 Jul 14 15:15:01.988538 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.988450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" event={"ID":"4a900cf0-1ca9-4c5b-bd6c-c21ed5220343","Type":"ContainerDied","Data":"d01c49d7410ebccaa60cb098ae71dbfa6185efccaf56014ea14f293f065ab8b5"} Jul 14 15:15:01.989833 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.989812 2562 generic.go:356] "Generic (PLEG): container finished" podID="3995f58f-43df-4803-975d-08dc5534b1b6" containerID="51959760a4b08127b8368ae144c82ca3d99b9ca5afba16412cd0eaea89708232" exitCode=0 Jul 14 15:15:01.989951 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.989871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" event={"ID":"3995f58f-43df-4803-975d-08dc5534b1b6","Type":"ContainerDied","Data":"51959760a4b08127b8368ae144c82ca3d99b9ca5afba16412cd0eaea89708232"} Jul 14 15:15:01.989951 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.989912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" event={"ID":"3995f58f-43df-4803-975d-08dc5534b1b6","Type":"ContainerStarted","Data":"d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe"} Jul 14 15:15:01.991234 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.991213 2562 generic.go:356] "Generic (PLEG): container finished" podID="585bf67c-51a3-4519-8c6b-1a67bad9e968" containerID="7307e68b5d4d432b8416b2f3d06239379d801cffd232f651497453a7dff4cb25" exitCode=0 Jul 14 15:15:01.991334 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:01.991237 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" event={"ID":"585bf67c-51a3-4519-8c6b-1a67bad9e968","Type":"ContainerDied","Data":"7307e68b5d4d432b8416b2f3d06239379d801cffd232f651497453a7dff4cb25"} Jul 14 15:15:03.143396 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.143368 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:03.192541 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.192518 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" Jul 14 15:15:03.195489 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.195471 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" Jul 14 15:15:03.203394 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.203368 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca\") pod \"3995f58f-43df-4803-975d-08dc5534b1b6\" (UID: \"3995f58f-43df-4803-975d-08dc5534b1b6\") " Jul 14 15:15:03.203665 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.203642 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3995f58f-43df-4803-975d-08dc5534b1b6" (UID: "3995f58f-43df-4803-975d-08dc5534b1b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:15:03.227227 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.227198 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" Jul 14 15:15:03.304354 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:03.304282 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3995f58f-43df-4803-975d-08dc5534b1b6-maas-api-service-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:15:04.009012 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.008988 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" Jul 14 15:15:04.009126 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.009059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb" event={"ID":"585bf67c-51a3-4519-8c6b-1a67bad9e968","Type":"ContainerDied","Data":"04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec"} Jul 14 15:15:04.009181 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.009141 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04539a02b33b9aedcd3b6d5064c0e7c803c050caee9b129adb44a4b4b8474dec" Jul 14 15:15:04.010382 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.010363 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" Jul 14 15:15:04.010505 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.010400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw" event={"ID":"e17df9e9-f1c2-4581-929e-fbc18b636095","Type":"ContainerDied","Data":"9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93"} Jul 14 15:15:04.010505 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.010468 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d709c43630a7de1e7d040d9d79d3623e8edcf84aedf1b008340a2044fe33a93" Jul 14 15:15:04.011932 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.011909 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" Jul 14 15:15:04.011932 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.011918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734035-drmz9" event={"ID":"4a900cf0-1ca9-4c5b-bd6c-c21ed5220343","Type":"ContainerDied","Data":"de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe"} Jul 14 15:15:04.012107 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.011954 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de8b5afde9ff88a11e1a4e3364730445926cfbb66ea028603fca2237ab6f4cbe" Jul 14 15:15:04.013369 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.013334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" event={"ID":"3995f58f-43df-4803-975d-08dc5534b1b6","Type":"ContainerDied","Data":"d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe"} Jul 14 15:15:04.013489 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.013389 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d86e0b2c1034e82c40ed26c1bc2c8fe998e358435515892f714c81b6a639fe" Jul 14 15:15:04.013489 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:04.013354 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf" Jul 14 15:15:11.408253 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:11.408213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:11.413540 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:11.413513 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw"] Jul 14 15:15:11.415635 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:11.415614 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ebb1a4-29734035-v22qw"] Jul 14 15:15:11.983109 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:11.983078 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17df9e9-f1c2-4581-929e-fbc18b636095" path="/var/lib/kubelet/pods/e17df9e9-f1c2-4581-929e-fbc18b636095/volumes" Jul 14 15:15:15.243487 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:15.243457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:15:15.962696 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:15.962643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:22.238026 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:22.237993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:22.537469 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:22.537379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:26.750365 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:26.750327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:26.985407 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:26.985349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:27.114757 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.114689 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr"] Jul 14 15:15:27.115008 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.114997 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17df9e9-f1c2-4581-929e-fbc18b636095" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115010 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17df9e9-f1c2-4581-929e-fbc18b636095" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115023 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a900cf0-1ca9-4c5b-bd6c-c21ed5220343" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115028 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a900cf0-1ca9-4c5b-bd6c-c21ed5220343" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115037 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585bf67c-51a3-4519-8c6b-1a67bad9e968" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115042 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="585bf67c-51a3-4519-8c6b-1a67bad9e968" containerName="cleanup" Jul 14 15:15:27.115056 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115054 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3995f58f-43df-4803-975d-08dc5534b1b6" containerName="revoke-keys" Jul 14 15:15:27.115243 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115059 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3995f58f-43df-4803-975d-08dc5534b1b6" containerName="revoke-keys" Jul 14 15:15:27.115243 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115112 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3995f58f-43df-4803-975d-08dc5534b1b6" containerName="revoke-keys" Jul 14 15:15:27.115243 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115119 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a900cf0-1ca9-4c5b-bd6c-c21ed5220343" containerName="cleanup" Jul 14 15:15:27.115243 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115128 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17df9e9-f1c2-4581-929e-fbc18b636095" containerName="cleanup" Jul 14 15:15:27.115243 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.115133 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="585bf67c-51a3-4519-8c6b-1a67bad9e968" containerName="cleanup" Jul 14 15:15:27.118167 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.118147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:27.121658 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.121640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 15:15:27.122177 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.122159 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5695q\"" Jul 14 15:15:27.128880 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.128856 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr"] Jul 14 15:15:27.301661 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.301626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr\" (UID: \"d9d2860f-5613-41af-8fc4-95dbc6e820da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:27.402576 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.402474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr\" (UID: \"d9d2860f-5613-41af-8fc4-95dbc6e820da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:27.403316 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.403294 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr\" (UID: \"d9d2860f-5613-41af-8fc4-95dbc6e820da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:27.429732 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.429707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:27.564457 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.564429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr"] Jul 14 15:15:27.565150 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:15:27.565125 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d2860f_5613_41af_8fc4_95dbc6e820da.slice/crio-796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed WatchSource:0}: Error finding container 796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed: Status 404 returned error can't find the container with id 796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed Jul 14 15:15:27.883495 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.883464 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:27.985402 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:27.985371 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:28.138017 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:28.137933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" event={"ID":"d9d2860f-5613-41af-8fc4-95dbc6e820da","Type":"ContainerStarted","Data":"120c23843ceaefadcf08bd9234fde36a235fc2bcb8b20fbd0ece8c64783bd930"} Jul 14 15:15:28.138017 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:28.137979 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" event={"ID":"d9d2860f-5613-41af-8fc4-95dbc6e820da","Type":"ContainerStarted","Data":"796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed"} Jul 14 15:15:28.165290 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:28.165242 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" podStartSLOduration=1.165228317 podStartE2EDuration="1.165228317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 15:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:15:28.164055292 +0000 UTC m=+2664.723244968" watchObservedRunningTime="2026-07-14 15:15:28.165228317 +0000 UTC m=+2664.724417972" Jul 14 15:15:29.144507 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:29.144478 2562 generic.go:356] "Generic (PLEG): container finished" podID="d9d2860f-5613-41af-8fc4-95dbc6e820da" containerID="120c23843ceaefadcf08bd9234fde36a235fc2bcb8b20fbd0ece8c64783bd930" exitCode=0 Jul 14 15:15:29.144901 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:29.144570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" event={"ID":"d9d2860f-5613-41af-8fc4-95dbc6e820da","Type":"ContainerDied","Data":"120c23843ceaefadcf08bd9234fde36a235fc2bcb8b20fbd0ece8c64783bd930"} Jul 14 15:15:30.276385 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:30.276362 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:30.330510 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:30.330482 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca\") pod \"d9d2860f-5613-41af-8fc4-95dbc6e820da\" (UID: \"d9d2860f-5613-41af-8fc4-95dbc6e820da\") " Jul 14 15:15:30.330865 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:30.330845 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d9d2860f-5613-41af-8fc4-95dbc6e820da" (UID: "d9d2860f-5613-41af-8fc4-95dbc6e820da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 15:15:30.431841 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:30.431756 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d2860f-5613-41af-8fc4-95dbc6e820da-maas-api-service-ca\") on node \"ip-10-0-135-215.ec2.internal\" DevicePath \"\"" Jul 14 15:15:31.155945 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:31.155909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" event={"ID":"d9d2860f-5613-41af-8fc4-95dbc6e820da","Type":"ContainerDied","Data":"796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed"} Jul 14 15:15:31.155945 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:31.155932 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr" Jul 14 15:15:31.156352 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:31.155981 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="796cbfcdc84b176b61d54b7ec569fc120633786eb6350f01946751026b1d3bed" Jul 14 15:15:37.624205 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:37.624176 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb"] Jul 14 15:15:37.627473 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:37.627451 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-747ac7-29734035-fzlvb"] Jul 14 15:15:37.818018 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:37.817991 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:37.983743 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:37.983713 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585bf67c-51a3-4519-8c6b-1a67bad9e968" path="/var/lib/kubelet/pods/585bf67c-51a3-4519-8c6b-1a67bad9e968/volumes" Jul 14 15:15:40.987950 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:40.987921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b4h98"] Jul 14 15:15:42.225512 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:42.225483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:48.993958 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:48.993927 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:49.069725 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:49.069666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:52.984326 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:52.984278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:53.231698 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:53.231651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:15:59.606023 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:59.605951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hvlb5_991bffc6-d089-4f2c-a6ec-172f789415a8/server/0.log" Jul 14 15:15:59.963432 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:59.963344 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4469fb8c-mtxlj_143bf469-131a-4662-a428-e5682bb29899/copy-manifests/0.log" Jul 14 15:15:59.983184 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:15:59.983157 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4469fb8c-mtxlj_143bf469-131a-4662-a428-e5682bb29899/manager/0.log" Jul 14 15:16:00.857743 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:00.857710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734035-drmz9_4a900cf0-1ca9-4c5b-bd6c-c21ed5220343/cleanup/0.log" Jul 14 15:16:01.218322 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:01.218241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-e0a4af-7rpgv_2bf93213-724d-42f3-a7fd-4dd9e9097387/revoke-keys/0.log" Jul 14 15:16:01.581989 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:01.581956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-03dca1-bnsdp_be42f547-76ac-487b-be83-5388ca56af6c/revoke-keys/0.log" Jul 14 15:16:01.975778 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:01.975756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-3fe6f3d4-gcsg5_ad2951bc-5868-48a8-8a0f-8cc567acbde6/revoke-keys/0.log" Jul 14 15:16:02.233796 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:02.233717 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-ebb1a4-kd5kf_3995f58f-43df-4803-975d-08dc5534b1b6/revoke-keys/0.log" Jul 14 15:16:02.349176 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:02.349147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-747ac7-kvmtr_d9d2860f-5613-41af-8fc4-95dbc6e820da/revoke-keys/0.log" Jul 14 15:16:03.402961 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.402930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/extract/0.log" Jul 14 15:16:03.424573 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.424550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/util/0.log" Jul 14 15:16:03.446880 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.446856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/pull/0.log" Jul 14 15:16:03.585793 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.585759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/pull/0.log" Jul 14 15:16:03.594635 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.594607 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/extract/0.log" Jul 14 15:16:03.604841 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.604825 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/util/0.log" Jul 14 15:16:03.730191 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.730166 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/util/0.log" Jul 14 15:16:03.736104 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.736081 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/pull/0.log" Jul 14 15:16:03.741726 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.741704 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/extract/0.log" Jul 14 15:16:03.849964 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.849940 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/util/0.log" Jul 14 15:16:03.856226 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.856204 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/pull/0.log" Jul 14 15:16:03.862068 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:03.862050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/extract/0.log" Jul 14 15:16:04.093898 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:04.093827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:16:04.102738 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:04.102717 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:16:04.106136 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:04.106118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:16:04.111467 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:04.111449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9d58s_44e66830-01ad-4755-bf81-9de5e6c504b0/ovn-acl-logging/0.log" Jul 14 15:16:04.788638 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:04.788610 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b4h98_ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3/limitador/0.log" Jul 14 15:16:05.444904 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:05.444872 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mbg5t_2a048b90-af4b-4475-b411-60650352e5e3/discovery/0.log" Jul 14 15:16:07.169558 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:07.169533 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-f6c4c_9b350e41-28f9-4b6e-a17e-d92a87fad3dd/main/0.log" Jul 14 15:16:11.507220 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:11.507185 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:16:11.634319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:11.634281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" limit=1024 Jul 14 15:16:14.665784 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:14.665745 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5d8w_4e86cea4-03bd-4f27-88ca-b9da41cb10a7/global-pull-secret-syncer/0.log" Jul 14 15:16:14.916617 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:14.916541 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jfm8m_14b3c577-3fda-4574-b2a3-ca24f1216d51/konnectivity-agent/0.log" Jul 14 15:16:15.068251 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:15.068226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-215.ec2.internal_fe91a953528a902b98bd89fe9453b0a7/haproxy/0.log" Jul 14 15:16:19.779696 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.779645 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/extract/0.log" Jul 14 15:16:19.810331 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.810304 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/util/0.log" Jul 14 15:16:19.835366 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.835341 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cpqqx_5fc17379-709d-408d-b96f-624c806dac73/pull/0.log" Jul 14 15:16:19.867231 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.867213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/extract/0.log" Jul 14 15:16:19.895969 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.895947 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/util/0.log" Jul 14 15:16:19.931361 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.931335 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gzmwr_81f566ef-efb0-4b40-ac3c-34ff044e4d4a/pull/0.log" Jul 14 15:16:19.961940 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.961920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/extract/0.log" Jul 14 15:16:19.992945 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:19.992928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/util/0.log" Jul 14 15:16:20.022554 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:20.022535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rfxdl_89b902b9-0360-4f37-8671-1b8345fcd807/pull/0.log" Jul 14 15:16:20.054270 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:20.054216 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/extract/0.log" Jul 14 15:16:20.077951 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:20.077930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/util/0.log" Jul 14 15:16:20.103063 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:20.103045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15wm69_234f4fc6-d0c4-4065-a38b-dc7114e958b2/pull/0.log" Jul 14 15:16:21.062347 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:21.062322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b4h98_ca0a1188-4fe1-4a65-bb22-cfbbadc28cd3/limitador/0.log" Jul 14 15:16:22.825720 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.825672 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/alertmanager/0.log" Jul 14 15:16:22.847781 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.847756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/config-reloader/0.log" Jul 14 15:16:22.875374 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.875349 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/kube-rbac-proxy-web/0.log" Jul 14 15:16:22.903610 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.903590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/kube-rbac-proxy/0.log" Jul 14 15:16:22.927945 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.927921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/kube-rbac-proxy-metric/0.log" Jul 14 15:16:22.955102 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.955085 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/prom-label-proxy/0.log" Jul 14 15:16:22.980088 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:22.980073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c820d8-9563-4825-bd65-89e6f35eaad8/init-config-reloader/0.log" Jul 14 15:16:23.163420 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:23.163339 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-559b78d747-q74tz_fe841d35-0854-4dd9-bb8a-3138129d25b5/metrics-server/0.log" Jul 14 15:16:23.239269 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:23.239235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dcp7_90998f11-e74d-4816-8def-9c524696c1f3/node-exporter/0.log" Jul 14 15:16:23.272109 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:23.272088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dcp7_90998f11-e74d-4816-8def-9c524696c1f3/kube-rbac-proxy/0.log" Jul 14 15:16:23.300420 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:23.300393 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dcp7_90998f11-e74d-4816-8def-9c524696c1f3/init-textfile/0.log" Jul 14 15:16:25.175616 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.175583 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql"] Jul 14 15:16:25.176028 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.175965 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d2860f-5613-41af-8fc4-95dbc6e820da" containerName="revoke-keys" Jul 14 15:16:25.176028 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.175978 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d2860f-5613-41af-8fc4-95dbc6e820da" containerName="revoke-keys" Jul 14 15:16:25.176137 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.176039 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d2860f-5613-41af-8fc4-95dbc6e820da" containerName="revoke-keys" Jul 14 15:16:25.179179 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.179160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.181992 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.181973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x95g4\"/\"kube-root-ca.crt\"" Jul 14 15:16:25.182593 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.182576 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x95g4\"/\"openshift-service-ca.crt\"" Jul 14 15:16:25.182669 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.182581 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x95g4\"/\"default-dockercfg-czkgw\"" Jul 14 15:16:25.189642 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.189621 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql"] Jul 14 15:16:25.264007 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.263979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-lib-modules\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.264007 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.264007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-podres\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.264165 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.264100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-proc\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.264165 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.264149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-sys\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.264232 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.264169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkft\" (UniqueName: \"kubernetes.io/projected/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-kube-api-access-2zkft\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365044 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-lib-modules\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365186 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-podres\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365186 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-proc\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365186 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-sys\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365186 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-lib-modules\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkft\" (UniqueName: \"kubernetes.io/projected/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-kube-api-access-2zkft\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365216 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-proc\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-podres\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.365319 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.365272 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-sys\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.376863 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.376843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkft\" (UniqueName: \"kubernetes.io/projected/d1a97a5d-de95-4ca2-8e84-474fe34b8f6e-kube-api-access-2zkft\") pod \"perf-node-gather-daemonset-6hzql\" (UID: \"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e\") " pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.489455 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.489433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:25.627408 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:25.627322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql"] Jul 14 15:16:25.630130 ip-10-0-135-215 kubenswrapper[2562]: W0714 15:16:25.630102 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1a97a5d_de95_4ca2_8e84_474fe34b8f6e.slice/crio-1cf86c7ea512634915fbaccd1bf5b77ff3b6b171c4a788faf00a8b72732ac372 WatchSource:0}: Error finding container 1cf86c7ea512634915fbaccd1bf5b77ff3b6b171c4a788faf00a8b72732ac372: Status 404 returned error can't find the container with id 1cf86c7ea512634915fbaccd1bf5b77ff3b6b171c4a788faf00a8b72732ac372 Jul 14 15:16:26.010982 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.010896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/2.log" Jul 14 15:16:26.017826 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.017802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-2s6bp_b8c96acb-77ea-4835-91bc-7de45c5d6d0f/console-operator/3.log" Jul 14 15:16:26.444327 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.444247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" event={"ID":"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e","Type":"ContainerStarted","Data":"6f396b753b38013f8020d734802af99848362173c4662ca14cff8101e2ca6597"} Jul 14 15:16:26.444327 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.444296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" event={"ID":"d1a97a5d-de95-4ca2-8e84-474fe34b8f6e","Type":"ContainerStarted","Data":"1cf86c7ea512634915fbaccd1bf5b77ff3b6b171c4a788faf00a8b72732ac372"} Jul 14 15:16:26.444768 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.444367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:26.481839 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:26.481793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" podStartSLOduration=1.481777975 podStartE2EDuration="1.481777975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 15:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 15:16:26.480912659 +0000 UTC m=+2723.040102327" watchObservedRunningTime="2026-07-14 15:16:26.481777975 +0000 UTC m=+2723.040967651" Jul 14 15:16:28.342850 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:28.342826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nvrf4_f6bbe485-4b58-47ba-a51b-5561289c4a8b/dns/0.log" Jul 14 15:16:28.372438 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:28.372408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nvrf4_f6bbe485-4b58-47ba-a51b-5561289c4a8b/kube-rbac-proxy/0.log" Jul 14 15:16:28.430836 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:28.430804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pv6nq_710ff849-bbba-4bee-bc62-240b56c9f52d/dns-node-resolver/0.log" Jul 14 15:16:29.026809 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:29.026782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76d4ddd784-gvblm_d907a407-6913-474a-bbfd-f253cbc90328/registry/0.log" Jul 14 15:16:29.062434 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:29.062407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5fdl_5686109b-f12b-42a6-ae2e-dce0ca3129c6/node-ca/0.log" Jul 14 15:16:30.293196 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:30.293171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mbg5t_2a048b90-af4b-4475-b411-60650352e5e3/discovery/0.log" Jul 14 15:16:31.273383 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:31.273358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j9whj_563b2180-4213-400c-90fc-4fb76cf71be8/serve-healthcheck-canary/0.log" Jul 14 15:16:31.931731 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:31.931707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h458h_41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0/kube-rbac-proxy/0.log" Jul 14 15:16:31.955854 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:31.955829 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h458h_41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0/exporter/0.log" Jul 14 15:16:31.992948 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:31.992926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h458h_41b6cc3a-28a7-44d1-8a0c-e6c59c7be9b0/extractor/0.log" Jul 14 15:16:32.459306 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:32.459283 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x95g4/perf-node-gather-daemonset-6hzql" Jul 14 15:16:34.929454 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:34.929370 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hvlb5_991bffc6-d089-4f2c-a6ec-172f789415a8/server/0.log" Jul 14 15:16:35.214471 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:35.214379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4469fb8c-mtxlj_143bf469-131a-4662-a428-e5682bb29899/manager/0.log" Jul 14 15:16:35.231560 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:35.231538 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4469fb8c-mtxlj_143bf469-131a-4662-a428-e5682bb29899/copy-manifests/0.log" Jul 14 15:16:35.785767 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:35.785736 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mbg5t_2a048b90-af4b-4475-b411-60650352e5e3/discovery/0.log" Jul 14 15:16:36.483879 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:36.483852 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fc6b4b856-q2rkn_56c8ccca-07d0-4802-a266-28322dca98e5/manager/0.log" Jul 14 15:16:37.456673 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:37.456623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mbg5t_2a048b90-af4b-4475-b411-60650352e5e3/discovery/0.log" Jul 14 15:16:41.429634 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:41.429543 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tsr2z_3132fd38-e19e-4e07-9ded-ddfd536b4125/migrator/0.log" Jul 14 15:16:41.450545 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:41.450520 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-tsr2z_3132fd38-e19e-4e07-9ded-ddfd536b4125/graceful-termination/0.log" Jul 14 15:16:41.804468 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:41.804441 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-lm4dl_da93c763-cb9f-4e2c-a223-e8388c036dd5/kube-storage-version-migrator-operator/1.log" Jul 14 15:16:41.805942 ip-10-0-135-215 kubenswrapper[2562]: I0714 15:16:41.805920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-lm4dl_da93c763-cb9f-4e2c-a223-e8388c036dd5/kube-storage-version-migrator-operator/0.log"