Jul 08 19:32:29.151854 ip-10-0-131-119 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 19:32:29.151867 ip-10-0-131-119 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 19:32:29.151876 ip-10-0-131-119 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 19:32:29.152718 ip-10-0-131-119 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 19:32:39.184238 ip-10-0-131-119 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 19:32:39.184253 ip-10-0-131-119 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6fd7af729541444c9d808d52c77a89ac -- Jul 08 19:34:42.898450 ip-10-0-131-119 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:34:43.275866 ip-10-0-131-119 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:43.275866 ip-10-0-131-119 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:34:43.275866 ip-10-0-131-119 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:43.275866 ip-10-0-131-119 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:34:43.275866 ip-10-0-131-119 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:43.276537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.275921 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:34:43.280699 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280684 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.280699 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280698 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280703 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280706 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280709 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280712 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280716 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280718 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280721 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280724 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280726 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280729 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280731 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280734 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280737 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280739 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280742 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280744 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280747 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280749 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280753 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.280766 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280756 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280759 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280761 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280763 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280766 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280770 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280775 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280778 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280781 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280784 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280786 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280789 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280792 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280795 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280797 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280800 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280805 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280808 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280811 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280814 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.281240 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280816 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280819 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280822 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280825 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280827 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280830 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280832 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280835 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280837 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280840 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280842 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280845 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280848 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280850 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280853 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280856 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280858 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280861 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280863 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.281750 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280865 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280868 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280870 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280873 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280875 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280878 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280880 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280883 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280885 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280888 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280891 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280893 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280896 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280899 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280901 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280904 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280906 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280910 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280913 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.282225 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280916 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280919 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280921 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280926 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280928 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280930 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280934 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280937 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280940 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280942 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280945 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280948 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280950 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280953 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280955 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280958 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280960 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280963 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280965 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.280967 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.282671 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281672 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281678 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281681 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281683 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281686 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281689 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281691 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281694 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281696 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281700 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281703 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281706 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281708 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281712 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281716 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281718 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281721 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281724 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281726 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.283134 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281729 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281732 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281735 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281738 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281740 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281742 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281745 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281747 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281750 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281753 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281756 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281759 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281761 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281764 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281766 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281769 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281771 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281775 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281778 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281780 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.283614 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281782 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281785 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281788 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281791 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281796 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281799 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281802 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281805 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281807 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281810 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281812 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281814 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281818 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281821 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281823 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281826 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281828 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281831 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281833 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281835 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.284372 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281838 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281840 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281843 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281845 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281847 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281850 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281853 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281856 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281858 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281861 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281863 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281866 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281868 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281871 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281874 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281876 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281878 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281881 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281883 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.285023 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281886 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281888 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281890 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281893 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281896 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281901 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281904 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281907 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281910 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281913 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281916 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281918 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281920 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281923 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281925 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281928 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281930 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281933 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281935 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281937 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.285521 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.281940 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282350 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282357 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282360 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282362 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282365 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282368 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282371 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282373 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282376 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282378 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282381 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282383 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282386 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282389 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282391 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282394 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282397 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282400 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282403 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.286021 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282405 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282408 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282410 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282414 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282417 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282420 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282422 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282425 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282427 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282429 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282432 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282434 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282436 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282439 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282442 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282444 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282447 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282450 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282454 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.286515 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282458 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282461 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282463 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282466 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282469 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282471 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282474 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282477 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282480 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282482 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282485 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282487 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282490 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282492 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282495 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282498 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282500 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282503 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282505 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282507 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.287001 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282510 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282512 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282515 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282517 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282520 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282522 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282524 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282527 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282529 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282532 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282535 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282539 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282541 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282545 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282548 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282551 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282553 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282556 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282558 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282561 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.287643 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282563 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282566 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282569 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282571 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282573 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282576 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282579 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282581 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282584 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282586 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282589 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282591 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282594 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282596 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282599 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282601 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282603 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282606 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282608 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282610 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.288129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.282613 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282682 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282692 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282702 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282709 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282716 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282720 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282724 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282729 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282732 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282734 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282738 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282742 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282745 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282748 2559 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282751 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282753 2559 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282756 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282759 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282764 2559 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282767 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282770 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282773 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282776 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:34:43.288653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282780 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282783 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282785 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282788 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282791 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282794 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282797 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282800 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282803 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282807 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282810 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282813 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282816 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282819 2559 flags.go:64] FLAG: --enable-server="true" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282821 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282825 2559 flags.go:64] FLAG: --event-burst="100" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282828 2559 flags.go:64] FLAG: --event-qps="50" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282831 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282834 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282837 2559 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282841 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282844 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282847 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282849 2559 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282852 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:34:43.289253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282855 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282858 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282861 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282865 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282867 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282870 2559 flags.go:64] FLAG: --feature-gates="" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282874 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282876 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282879 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282882 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282885 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282888 2559 flags.go:64] FLAG: --help="false" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282891 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282894 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282899 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282902 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282905 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282908 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282911 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282914 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282917 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282919 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282922 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282925 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:34:43.289846 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282928 2559 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282930 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282933 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282936 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282939 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282941 2559 flags.go:64] FLAG: --lock-file="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282944 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282947 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282950 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282955 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282959 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282961 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282965 2559 flags.go:64] FLAG: --logging-format="text" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282967 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282971 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282973 2559 flags.go:64] FLAG: --manifest-url="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282976 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282980 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282983 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282986 2559 flags.go:64] FLAG: --max-pods="110" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282989 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282992 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282996 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.282999 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283002 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:34:43.290494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283004 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283007 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283014 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283017 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283020 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283023 2559 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283026 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283031 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283034 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283037 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283040 2559 flags.go:64] FLAG: --port="10250" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283043 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283046 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e89c17c4e4f24eba" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283049 2559 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283052 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283055 2559 flags.go:64] FLAG: --register-node="true" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283057 2559 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283066 2559 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283069 2559 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283072 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283075 2559 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283079 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283082 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283085 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283088 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:34:43.291092 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283090 2559 flags.go:64] FLAG: --runonce="false" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283093 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283096 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283099 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283102 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283106 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283108 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283111 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283115 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283117 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283120 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283123 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283125 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283128 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283131 2559 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283134 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283139 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283142 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283145 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283150 2559 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283153 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283155 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283158 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283161 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283164 2559 flags.go:64] FLAG: --v="2" Jul 08 19:34:43.291714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283167 2559 flags.go:64] FLAG: --version="false" Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283184 2559 flags.go:64] FLAG: --vmodule="" Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283188 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.283192 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283339 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283353 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283357 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283360 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283363 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283366 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283369 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283373 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283375 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283378 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283382 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283385 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283388 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283390 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283393 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283396 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.292381 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283398 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283401 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283403 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283406 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283408 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283411 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283414 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283418 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283422 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283425 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283427 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283430 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283433 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283436 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283438 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283441 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283443 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283447 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283451 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.292873 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283455 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283458 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283462 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283465 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283467 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283470 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283473 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283476 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283479 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283482 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283485 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283487 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283490 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283494 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283497 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283500 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283503 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283505 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283508 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283510 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.293356 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283513 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283515 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283517 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283520 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283522 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283525 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283528 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283530 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283533 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283535 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283541 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283544 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283546 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283549 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283551 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283554 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283556 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283559 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283562 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.293847 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283564 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283567 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283612 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283648 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283652 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283654 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283657 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283661 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.283664 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284209 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284232 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284238 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284243 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284249 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284253 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284258 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284264 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284269 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284274 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284278 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.294325 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284283 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284293 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284297 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284301 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.284306 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.285106 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.294009 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.294022 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.294689 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.294697 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294752 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294758 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294762 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294765 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294767 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.294804 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294770 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294773 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294775 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294778 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294782 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294785 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294788 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294791 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294794 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294798 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294801 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294804 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294807 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294810 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294813 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294817 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294819 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294823 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294825 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.295191 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294828 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294831 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294833 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294835 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294838 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294841 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294843 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294846 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294849 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294852 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294855 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294858 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294861 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294863 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294866 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294869 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294872 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294875 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294877 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294880 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.295648 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294882 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294885 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294887 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294890 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294892 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294895 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294897 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294900 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294902 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294904 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294907 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294910 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294912 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294914 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294917 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294920 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294922 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294924 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294927 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294929 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.296139 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294932 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294935 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294937 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294939 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294942 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294944 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294947 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294950 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294953 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294955 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294957 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294960 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294962 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294965 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294967 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294969 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294972 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294974 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294977 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.296640 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294979 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294982 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294984 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294987 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294989 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294992 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294994 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294996 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.294999 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295001 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295003 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295006 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295008 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295011 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295013 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.297094 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295016 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.295020 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295129 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295133 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295136 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295140 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295143 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295145 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295148 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295150 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295153 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295155 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295157 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295160 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:43.297469 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295162 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295165 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295167 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295169 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295187 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295190 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295193 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295196 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295199 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295202 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295204 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295207 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295209 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295212 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295214 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295217 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295219 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295222 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295225 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295227 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:43.297801 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295229 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295232 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295234 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295237 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295240 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295243 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295245 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295248 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295251 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295253 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295255 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295258 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295261 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295264 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295267 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295269 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295272 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295274 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295277 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295279 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:43.298387 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295282 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295284 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295287 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295289 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295292 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295294 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295296 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295300 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295303 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295307 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295309 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295312 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295315 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295317 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295320 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295322 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295325 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295327 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295331 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:43.298919 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295333 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295336 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295339 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295342 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295345 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295348 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295351 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295353 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295356 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295358 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295361 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295363 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295366 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295368 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295370 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295373 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295375 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295378 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295380 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295383 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:43.299396 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295385 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295388 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295390 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295393 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295395 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295397 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295399 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:43.295402 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.295407 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.295538 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:34:43.299862 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.298660 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:34:43.300225 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.300214 2559 server.go:1019] "Starting client certificate rotation" Jul 08 19:34:43.300347 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.300327 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:34:43.300406 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.300370 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:34:43.302719 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.302695 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:34:43.304957 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.304942 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:34:43.313159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.313141 2559 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:34:43.318214 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.318193 2559 log.go:25] "Validated CRI v1 image API" Jul 08 19:34:43.319004 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.318987 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:34:43.322874 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.322853 2559 fs.go:135] Filesystem UUIDs: map[2bfaf005-bda9-46d6-98af-bdd49105663b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad62390f-405a-4b27-8712-32e486a7e7fb:/dev/nvme0n1p3] Jul 08 19:34:43.322944 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.322873 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:34:43.327934 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.327804 2559 manager.go:216] Machine: {Timestamp:2026-07-08 19:34:43.326579448 +0000 UTC m=+0.314383311 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101872 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29085fd40427cb319224efc48e3132 SystemUUID:ec29085f-d404-27cb-3192-24efc48e3132 BootID:6fd7af72-9541-444c-9d80-8d52c77a89ac Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:5c:6c:42:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:5c:6c:42:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:8a:d6:18:c3:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:34:43.327934 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.327931 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:34:43.328065 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.328047 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:34:43.329775 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.329757 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:34:43.330826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.330803 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:34:43.330957 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.330829 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:34:43.331537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.331526 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:34:43.331537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.331538 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:34:43.331619 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.331545 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:34:43.332301 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.332290 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:34:43.333818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.333808 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:34:43.337101 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337091 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:34:43.337220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337211 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:34:43.337256 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337239 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:34:43.337283 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337257 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:34:43.337283 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337274 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:34:43.337283 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337283 2559 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:34:43.337368 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337292 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:34:43.337644 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337634 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:34:43.337707 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.337653 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:34:43.339680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.339665 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:34:43.341869 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.341856 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:34:43.341907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.341886 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:34:43.343356 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343342 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343362 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343368 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343373 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343383 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343388 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:34:43.343403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343398 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:34:43.343550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343407 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:34:43.343550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343416 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:34:43.343550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343421 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:34:43.343550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343429 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:34:43.343550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.343435 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:34:43.344195 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.344170 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:34:43.344227 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.344197 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:34:43.347388 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.347364 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:34:43.347517 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.347491 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:34:43.347586 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.347492 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:34:43.347673 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.347662 2559 server.go:1268] "Started kubelet" Jul 08 19:34:43.347746 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.347722 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:34:43.347966 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.347781 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:34:43.348230 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.348213 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:34:43.348798 ip-10-0-131-119 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:34:43.349755 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.349741 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:34:43.349805 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.349752 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:34:43.351707 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.351677 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rtn8t" Jul 08 19:34:43.356143 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.356094 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:34:43.357368 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.354100 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-119.ec2.internal.18c0678752e3f2e2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-119.ec2.internal,UID:ip-10-0-131-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-119.ec2.internal,},FirstTimestamp:2026-07-08 19:34:43.347632866 +0000 UTC m=+0.335436729,LastTimestamp:2026-07-08 19:34:43.347632866 +0000 UTC m=+0.335436729,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-119.ec2.internal,}" Jul 08 19:34:43.359161 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.359145 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:34:43.359292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.359163 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:34:43.359292 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.359231 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.359930 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.359876 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:34:43.359930 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.359894 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:34:43.360040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360004 2559 factory.go:55] Registering systemd factory Jul 08 19:34:43.360040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360021 2559 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:34:43.360040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360027 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:34:43.360040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360034 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:34:43.360375 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360356 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:34:43.360592 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360578 2559 factory.go:153] Registering CRI-O factory Jul 08 19:34:43.360655 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360622 2559 factory.go:223] Registration of the crio container factory successfully Jul 08 19:34:43.360719 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360683 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:34:43.360719 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360706 2559 factory.go:103] Registering Raw factory Jul 08 19:34:43.360843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.360723 2559 manager.go:1196] Started watching for new ooms in manager Jul 08 19:34:43.361088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.361075 2559 manager.go:349] Starting recovery of all containers Jul 08 19:34:43.361301 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.361277 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:34:43.361431 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.361408 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:34:43.361559 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.361542 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rtn8t" Jul 08 19:34:43.369662 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.369432 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:34:43.371239 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.371221 2559 manager.go:354] Recovery completed Jul 08 19:34:43.375518 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.375506 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.377470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.377453 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.377543 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.377483 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.377543 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.377495 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.378034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378020 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:34:43.378034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378030 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.378139 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378032 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:34:43.378200 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378155 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:34:43.378939 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378920 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.379005 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378952 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.379005 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.378964 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.379225 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.379209 2559 policy_none.go:49] "None policy: Start" Jul 08 19:34:43.379225 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.379226 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:34:43.379315 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.379237 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:34:43.380129 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.380118 2559 policy_none.go:47] "Start" Jul 08 19:34:43.413736 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.413712 2559 manager.go:337] "Starting Device Plugin manager" Jul 08 19:34:43.413805 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.413749 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:34:43.413805 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.413763 2559 server.go:87] "Starting device plugin registration server" Jul 08 19:34:43.414025 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.414013 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:34:43.414077 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.414026 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:34:43.414148 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.414133 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:34:43.414254 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.414239 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:34:43.414254 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.414251 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:34:43.414708 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.414688 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:34:43.414776 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.414745 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.514562 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.514543 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.515575 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.515504 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.515575 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.515534 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.515575 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.515543 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.515575 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.515565 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.523226 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.523209 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.523317 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.523229 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-119.ec2.internal\": node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.537210 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.537146 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.541400 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.541384 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:34:43.541484 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.541426 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:34:43.541484 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.541449 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:34:43.541583 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.541486 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:34:43.543526 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.543511 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:43.637641 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.637607 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.641755 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.641739 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal"] Jul 08 19:34:43.641806 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.641793 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.643346 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.643330 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.643410 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.643362 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.643410 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.643375 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.644731 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.644719 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.644874 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.644850 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.644913 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.644881 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.645435 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645403 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.645512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645442 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.645512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645451 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.645512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645483 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.645512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645503 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.645512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.645514 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.646595 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.646581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.646638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.646612 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:43.647339 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.647323 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:43.647424 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.647350 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:43.647424 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.647359 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:43.671702 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.671685 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-119.ec2.internal\" not found" node="ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.675947 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.675925 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-119.ec2.internal\" not found" node="ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.737982 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.737963 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.761088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.761067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.761202 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.761091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a0bc436887006b5401efbd37faaf404-config\") pod \"kube-apiserver-proxy-ip-10-0-131-119.ec2.internal\" (UID: \"9a0bc436887006b5401efbd37faaf404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.761202 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.761115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.838431 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.838385 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.861759 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a0bc436887006b5401efbd37faaf404-config\") pod \"kube-apiserver-proxy-ip-10-0-131-119.ec2.internal\" (UID: \"9a0bc436887006b5401efbd37faaf404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.861845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.861845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.861845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.861941 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9a0bc436887006b5401efbd37faaf404-config\") pod \"kube-apiserver-proxy-ip-10-0-131-119.ec2.internal\" (UID: \"9a0bc436887006b5401efbd37faaf404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.861941 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.861854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2b7727f0a6dbd3ca58ac02e8e3805c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal\" (UID: \"e2b7727f0a6dbd3ca58ac02e8e3805c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.938896 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:43.938866 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:43.975370 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.975349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:43.980554 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:43.980534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:44.039190 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.039150 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.139680 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.139622 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.197830 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.197808 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:44.239854 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.239832 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.265461 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.265442 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:44.299550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.299534 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:34:44.300033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.299643 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:34:44.300033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.299682 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:34:44.300033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.299682 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:34:44.339948 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.339916 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.367426 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.367397 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 19:29:43 +0000 UTC" deadline="2028-04-07 03:42:07.217575638 +0000 UTC" Jul 08 19:34:44.367426 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.367422 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15320h7m22.850156132s" Jul 08 19:34:44.440129 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.440105 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.529746 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:44.529708 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0bc436887006b5401efbd37faaf404.slice/crio-2126f344efee2e9bb76d73ddabecb032f804bb37e544e59ba5326ffc27848dfb WatchSource:0}: Error finding container 2126f344efee2e9bb76d73ddabecb032f804bb37e544e59ba5326ffc27848dfb: Status 404 returned error can't find the container with id 2126f344efee2e9bb76d73ddabecb032f804bb37e544e59ba5326ffc27848dfb Jul 08 19:34:44.533222 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.533209 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:34:44.540749 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.540733 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.544356 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.544320 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" event={"ID":"9a0bc436887006b5401efbd37faaf404","Type":"ContainerStarted","Data":"2126f344efee2e9bb76d73ddabecb032f804bb37e544e59ba5326ffc27848dfb"} Jul 08 19:34:44.641816 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:44.641786 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-119.ec2.internal\" not found" Jul 08 19:34:44.655453 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.655403 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:44.659308 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.659295 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" Jul 08 19:34:44.669230 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.669217 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:34:44.670170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.670154 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" Jul 08 19:34:44.677987 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:44.677971 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:34:44.779461 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:44.779438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b7727f0a6dbd3ca58ac02e8e3805c8.slice/crio-c3a18df9d7d978bfdce9d7e9940f03c5fb8201c4fa74f73cf29917ffe62ff01a WatchSource:0}: Error finding container c3a18df9d7d978bfdce9d7e9940f03c5fb8201c4fa74f73cf29917ffe62ff01a: Status 404 returned error can't find the container with id c3a18df9d7d978bfdce9d7e9940f03c5fb8201c4fa74f73cf29917ffe62ff01a Jul 08 19:34:45.338328 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.338298 2559 apiserver.go:52] "Watching apiserver" Jul 08 19:34:45.345234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.345212 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:34:45.347987 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.347530 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-n9r2s","openshift-multus/network-metrics-daemon-2b7nn","openshift-network-diagnostics/network-check-target-k6q7x","openshift-network-operator/iptables-alerter-wrtb2","openshift-ovn-kubernetes/ovnkube-node-8cg2d","kube-system/global-pull-secret-syncer-755zf","kube-system/konnectivity-agent-mjphv","kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f","openshift-cluster-node-tuning-operator/tuned-d5b7n","openshift-dns/node-resolver-pn57x","openshift-image-registry/node-ca-57sf7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal","openshift-multus/multus-additional-cni-plugins-cb2rm"] Jul 08 19:34:45.350069 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.350049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.351974 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.351954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.352684 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.352663 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:34:45.352771 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.352728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8d9w9\"" Jul 08 19:34:45.352771 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.352663 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:34:45.354254 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.353979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:45.354254 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.354038 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:45.354254 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.354107 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-69nct\"" Jul 08 19:34:45.355400 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.354151 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.355495 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.354350 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.355980 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.355736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.358054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.358037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.358156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.358140 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:34:45.358273 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.358259 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.358348 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.358338 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qsdmd\"" Jul 08 19:34:45.358870 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.358735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.360057 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.360040 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:34:45.360853 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.360838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.360932 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.360896 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:45.361235 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:34:45.361382 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.361489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361476 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:34:45.361570 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361554 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:34:45.361660 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmwcl\"" Jul 08 19:34:45.361779 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361761 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.361847 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.361830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:34:45.362928 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.362900 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.365223 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.365203 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.365570 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.365451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lb7wv\"" Jul 08 19:34:45.365627 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.365615 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:34:45.366793 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.366774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.367079 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.367059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.368745 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-hosts-file\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.368828 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.368828 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.368828 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:45.368976 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53dbc076-851f-4a17-9168-2d1541534b26-host-slash\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.368976 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2fq\" (UniqueName: \"kubernetes.io/projected/53dbc076-851f-4a17-9168-2d1541534b26-kube-api-access-dv2fq\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.368976 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgl7s\" (UniqueName: \"kubernetes.io/projected/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-kube-api-access-zgl7s\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.369071 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.368923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-etc-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369071 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-dbus\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.369071 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-sys-fs\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-device-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a02fe3-c467-4503-9cdd-05aa38c92b38-konnectivity-ca\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369107 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369157 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-config\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369226 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-slash\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-var-lib-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-ovn\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-tmp-dir\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-systemd-units\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369454 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-node-log\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-bin\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-socket-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-netns\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-log-socket\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-netd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369638 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-env-overrides\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369673 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovn-node-metrics-cert\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-script-lib\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369747 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nprs9\"" Jul 08 19:34:45.369785 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53dbc076-851f-4a17-9168-2d1541534b26-iptables-alerter-script\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a02fe3-c467-4503-9cdd-05aa38c92b38-agent-certs\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369860 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-kubelet\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-systemd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbq6\" (UniqueName: \"kubernetes.io/projected/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-kube-api-access-cpbq6\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-kubelet-config\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.369988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-registration-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.370034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwsp\" (UniqueName: \"kubernetes.io/projected/77248c84-f6c8-44ef-93ea-8f1943e063ef-kube-api-access-lgwsp\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.370060 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.370218 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.370115 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:45.372204 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.371955 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:34:45.372204 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.372150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.374993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.374977 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5zvrd\"" Jul 08 19:34:45.375141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.375119 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.375249 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.375200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.376163 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.375886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.378954 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.378204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:34:45.378954 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.378442 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-blzds\"" Jul 08 19:34:45.379544 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.379248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.382077 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.382061 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:34:45.382077 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.382064 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:34:45.382345 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.382332 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6fwkd\"" Jul 08 19:34:45.383116 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.383098 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:34:45.407934 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.407911 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-65zbc" Jul 08 19:34:45.417291 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.417259 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-65zbc" Jul 08 19:34:45.461958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.461932 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:34:45.470884 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrqc\" (UniqueName: \"kubernetes.io/projected/4939a718-e97c-4533-8ff3-90eb5cc09726-kube-api-access-whrqc\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgl7s\" (UniqueName: \"kubernetes.io/projected/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-kube-api-access-zgl7s\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn287\" (UniqueName: \"kubernetes.io/projected/fc37c758-7eff-42f2-9c79-6383b3c01abf-kube-api-access-zn287\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rfbp\" (UniqueName: \"kubernetes.io/projected/7bf4fd49-4b94-469f-9c93-64accc80e6d7-kube-api-access-2rfbp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-os-release\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.471020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.470999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-lib-modules\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-cnibin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-daemon-config\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-etc-kubernetes\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4stt\" (UniqueName: \"kubernetes.io/projected/d6512e99-de0c-4f7b-804d-231b6f38ac55-kube-api-access-m4stt\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4939a718-e97c-4533-8ff3-90eb5cc09726-host\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4939a718-e97c-4533-8ff3-90eb5cc09726-serviceca\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-sys-fs\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-device-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-system-cni-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-system-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-bin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-kubelet\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysconfig\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-systemd\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-tuned\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-socket-dir-parent\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-multus\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-tmp-dir\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-bin\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-run\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-sys\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-var-lib-kubelet\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-socket-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-netns\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovn-node-metrics-cert\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbq6\" (UniqueName: \"kubernetes.io/projected/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-kube-api-access-cpbq6\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.471993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471694 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-kubelet-config\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a02fe3-c467-4503-9cdd-05aa38c92b38-agent-certs\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-sys-fs\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-k8s-cni-cncf-io\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwsp\" (UniqueName: \"kubernetes.io/projected/77248c84-f6c8-44ef-93ea-8f1943e063ef-kube-api-access-lgwsp\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-device-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53dbc076-851f-4a17-9168-2d1541534b26-host-slash\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2fq\" (UniqueName: \"kubernetes.io/projected/53dbc076-851f-4a17-9168-2d1541534b26-kube-api-access-dv2fq\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cnibin\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-host\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-tmp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.471998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-hostroot\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-etc-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.472873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-etc-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53dbc076-851f-4a17-9168-2d1541534b26-host-slash\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-socket-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.472342 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.472397 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:45.972382278 +0000 UTC m=+2.960186127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472424 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472738 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-kubelet-config\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-dbus\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a02fe3-c467-4503-9cdd-05aa38c92b38-konnectivity-ca\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-config\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e575239b-2bc0-4d4b-bca5-cea88e401d80-dbus\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.472912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-netns\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473174 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-slash\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.473672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-kubernetes\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-conf\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-cni-binary-copy\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-script-lib\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-modprobe-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-var-lib-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-config\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-ovn\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-systemd-units\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-log-socket\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-tmp-dir\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-netd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-netd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-slash\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.474411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473703 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-env-overrides\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-cni-bin\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-run-netns\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473766 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-var-lib-openvswitch\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-ovn\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473840 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-systemd-units\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.473869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-log-socket\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-env-overrides\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a02fe3-c467-4503-9cdd-05aa38c92b38-konnectivity-ca\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmq9\" (UniqueName: \"kubernetes.io/projected/b9c14c52-a3bc-4850-b500-3fac7a15f33e-kube-api-access-4qmq9\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-node-log\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-os-release\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53dbc076-851f-4a17-9168-2d1541534b26-iptables-alerter-script\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-kubelet\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-systemd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474673 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-multus-certs\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-registration-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-hosts-file\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovnkube-script-lib\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-conf-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-hosts-file\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-node-log\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474894 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-run-systemd\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77248c84-f6c8-44ef-93ea-8f1943e063ef-registration-dir\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.474984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-host-kubelet\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.475883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.475378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53dbc076-851f-4a17-9168-2d1541534b26-iptables-alerter-script\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.476978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a02fe3-c467-4503-9cdd-05aa38c92b38-agent-certs\") pod \"konnectivity-agent-mjphv\" (UID: \"99a02fe3-c467-4503-9cdd-05aa38c92b38\") " pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.477472 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.477491 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.477501 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.477554 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:45.977537653 +0000 UTC m=+2.965341504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:45.478366 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.477985 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-ovn-node-metrics-cert\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.483074 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.483028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgl7s\" (UniqueName: \"kubernetes.io/projected/44a97c13-4c66-40f6-b7fc-0898c34e0e6d-kube-api-access-zgl7s\") pod \"node-resolver-pn57x\" (UID: \"44a97c13-4c66-40f6-b7fc-0898c34e0e6d\") " pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.483872 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.483843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbq6\" (UniqueName: \"kubernetes.io/projected/84ff4ed4-11e3-4ee1-95ea-6f82e1396a79-kube-api-access-cpbq6\") pod \"ovnkube-node-8cg2d\" (UID: \"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79\") " pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.486971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.486948 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2fq\" (UniqueName: \"kubernetes.io/projected/53dbc076-851f-4a17-9168-2d1541534b26-kube-api-access-dv2fq\") pod \"iptables-alerter-wrtb2\" (UID: \"53dbc076-851f-4a17-9168-2d1541534b26\") " pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.489953 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.489928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwsp\" (UniqueName: \"kubernetes.io/projected/77248c84-f6c8-44ef-93ea-8f1943e063ef-kube-api-access-lgwsp\") pod \"aws-ebs-csi-driver-node-vt48f\" (UID: \"77248c84-f6c8-44ef-93ea-8f1943e063ef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.546775 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.546743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" event={"ID":"e2b7727f0a6dbd3ca58ac02e8e3805c8","Type":"ContainerStarted","Data":"c3a18df9d7d978bfdce9d7e9940f03c5fb8201c4fa74f73cf29917ffe62ff01a"} Jul 08 19:34:45.575122 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-netns\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-kubernetes\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-conf\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-cni-binary-copy\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.575322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-modprobe-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmq9\" (UniqueName: \"kubernetes.io/projected/b9c14c52-a3bc-4850-b500-3fac7a15f33e-kube-api-access-4qmq9\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-os-release\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-multus-certs\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-conf-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrqc\" (UniqueName: \"kubernetes.io/projected/4939a718-e97c-4533-8ff3-90eb5cc09726-kube-api-access-whrqc\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn287\" (UniqueName: \"kubernetes.io/projected/fc37c758-7eff-42f2-9c79-6383b3c01abf-kube-api-access-zn287\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rfbp\" (UniqueName: \"kubernetes.io/projected/7bf4fd49-4b94-469f-9c93-64accc80e6d7-kube-api-access-2rfbp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-os-release\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-lib-modules\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-cnibin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-daemon-config\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-etc-kubernetes\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4stt\" (UniqueName: \"kubernetes.io/projected/d6512e99-de0c-4f7b-804d-231b6f38ac55-kube-api-access-m4stt\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4939a718-e97c-4533-8ff3-90eb5cc09726-host\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.575720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4939a718-e97c-4533-8ff3-90eb5cc09726-serviceca\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-system-cni-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-system-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-bin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-kubelet\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysconfig\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-systemd\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-tuned\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-socket-dir-parent\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-multus\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-run\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-sys\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-var-lib-kubelet\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.575974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-k8s-cni-cncf-io\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cnibin\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-host\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-tmp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.576536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-hostroot\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-hostroot\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576297 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-netns\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-kubernetes\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysctl-conf\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.576564 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-cni-binary-copy\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.577206 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4939a718-e97c-4533-8ff3-90eb5cc09726-host\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.577270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:34:46.077255029 +0000 UTC m=+3.065058883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577296 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-socket-dir-parent\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-run\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-sys\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.577430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-var-lib-kubelet\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577660 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4939a718-e97c-4533-8ff3-90eb5cc09726-serviceca\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577703 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-system-cni-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-system-cni-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-bin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-kubelet\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-sysconfig\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-systemd\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-var-lib-cni-multus\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-k8s-cni-cncf-io\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.577954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cnibin\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578041 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-host\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578304 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9c14c52-a3bc-4850-b500-3fac7a15f33e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-os-release\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-host-run-multus-certs\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-conf-dir\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9c14c52-a3bc-4850-b500-3fac7a15f33e-os-release\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.578615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-cnibin\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578905 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-modprobe-d\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.578905 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6512e99-de0c-4f7b-804d-231b6f38ac55-etc-kubernetes\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.578905 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bf4fd49-4b94-469f-9c93-64accc80e6d7-lib-modules\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.579028 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.578904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6512e99-de0c-4f7b-804d-231b6f38ac55-multus-daemon-config\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.580663 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.580640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-tmp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.580753 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.580685 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7bf4fd49-4b94-469f-9c93-64accc80e6d7-etc-tuned\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.587269 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.587243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4stt\" (UniqueName: \"kubernetes.io/projected/d6512e99-de0c-4f7b-804d-231b6f38ac55-kube-api-access-m4stt\") pod \"multus-n9r2s\" (UID: \"d6512e99-de0c-4f7b-804d-231b6f38ac55\") " pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.587667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.587627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrqc\" (UniqueName: \"kubernetes.io/projected/4939a718-e97c-4533-8ff3-90eb5cc09726-kube-api-access-whrqc\") pod \"node-ca-57sf7\" (UID: \"4939a718-e97c-4533-8ff3-90eb5cc09726\") " pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.588137 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.588116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmq9\" (UniqueName: \"kubernetes.io/projected/b9c14c52-a3bc-4850-b500-3fac7a15f33e-kube-api-access-4qmq9\") pod \"multus-additional-cni-plugins-cb2rm\" (UID: \"b9c14c52-a3bc-4850-b500-3fac7a15f33e\") " pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.589355 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.589300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn287\" (UniqueName: \"kubernetes.io/projected/fc37c758-7eff-42f2-9c79-6383b3c01abf-kube-api-access-zn287\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:45.589611 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.589595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rfbp\" (UniqueName: \"kubernetes.io/projected/7bf4fd49-4b94-469f-9c93-64accc80e6d7-kube-api-access-2rfbp\") pod \"tuned-d5b7n\" (UID: \"7bf4fd49-4b94-469f-9c93-64accc80e6d7\") " pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.661564 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.661537 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:34:45.669236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.669212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pn57x" Jul 08 19:34:45.680153 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.680122 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wrtb2" Jul 08 19:34:45.687045 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.687024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:34:45.697855 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.697831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" Jul 08 19:34:45.705544 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.705523 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" Jul 08 19:34:45.713197 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.713162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" Jul 08 19:34:45.720714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.720697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9r2s" Jul 08 19:34:45.728240 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.728219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-57sf7" Jul 08 19:34:45.890618 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.890558 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:45.979707 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.979664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:45.979866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:45.979734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:45.979866 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979803 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:45.979944 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979869 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:45.979944 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979882 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:46.979860249 +0000 UTC m=+3.967664102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:45.979944 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979884 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:45.979944 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979897 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:45.980081 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:45.979950 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:46.979936804 +0000 UTC m=+3.967740655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:46.080875 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.080849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:46.081031 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.080951 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:46.081031 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.081001 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:34:47.08098836 +0000 UTC m=+4.068792208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:46.191726 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.191648 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:46.330397 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.330366 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:46.421159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.421131 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:29:45 +0000 UTC" deadline="2027-12-11 04:19:59.84798927 +0000 UTC" Jul 08 19:34:46.421159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.421159 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12488h45m13.426833401s" Jul 08 19:34:46.426700 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.426674 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dbc076_851f_4a17_9168_2d1541534b26.slice/crio-06049f18b55078d97b2dd1e5412b7f5f77f6640baa5ff0f29d4eb04d3db2bcd1 WatchSource:0}: Error finding container 06049f18b55078d97b2dd1e5412b7f5f77f6640baa5ff0f29d4eb04d3db2bcd1: Status 404 returned error can't find the container with id 06049f18b55078d97b2dd1e5412b7f5f77f6640baa5ff0f29d4eb04d3db2bcd1 Jul 08 19:34:46.428976 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.428842 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf4fd49_4b94_469f_9c93_64accc80e6d7.slice/crio-bafb8d79757ca9058a84140e1eff49b1f667bc3a4660c35e600a2a9e54fd5cac WatchSource:0}: Error finding container bafb8d79757ca9058a84140e1eff49b1f667bc3a4660c35e600a2a9e54fd5cac: Status 404 returned error can't find the container with id bafb8d79757ca9058a84140e1eff49b1f667bc3a4660c35e600a2a9e54fd5cac Jul 08 19:34:46.434925 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.434817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ff4ed4_11e3_4ee1_95ea_6f82e1396a79.slice/crio-5f933ba5b53d93018c45b920dcd306d8021d8f0bcb55f038717963866feefa8b WatchSource:0}: Error finding container 5f933ba5b53d93018c45b920dcd306d8021d8f0bcb55f038717963866feefa8b: Status 404 returned error can't find the container with id 5f933ba5b53d93018c45b920dcd306d8021d8f0bcb55f038717963866feefa8b Jul 08 19:34:46.436129 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.436108 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a02fe3_c467_4503_9cdd_05aa38c92b38.slice/crio-7ac0e523b5d17a7458ec68b043e0c2703e93f9375af19c9f99fd17acfac26632 WatchSource:0}: Error finding container 7ac0e523b5d17a7458ec68b043e0c2703e93f9375af19c9f99fd17acfac26632: Status 404 returned error can't find the container with id 7ac0e523b5d17a7458ec68b043e0c2703e93f9375af19c9f99fd17acfac26632 Jul 08 19:34:46.438019 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.437644 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c14c52_a3bc_4850_b500_3fac7a15f33e.slice/crio-b3eb1e8d61ef4b125edc69c16002ba415ee571c3cbfd427eabbdedec7be1f54e WatchSource:0}: Error finding container b3eb1e8d61ef4b125edc69c16002ba415ee571c3cbfd427eabbdedec7be1f54e: Status 404 returned error can't find the container with id b3eb1e8d61ef4b125edc69c16002ba415ee571c3cbfd427eabbdedec7be1f54e Jul 08 19:34:46.439223 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.438836 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a97c13_4c66_40f6_b7fc_0898c34e0e6d.slice/crio-6216089b9bad337c0daa7463dd181818eb41698d9fac4e2120fdd697f13215c9 WatchSource:0}: Error finding container 6216089b9bad337c0daa7463dd181818eb41698d9fac4e2120fdd697f13215c9: Status 404 returned error can't find the container with id 6216089b9bad337c0daa7463dd181818eb41698d9fac4e2120fdd697f13215c9 Jul 08 19:34:46.440450 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.439569 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4939a718_e97c_4533_8ff3_90eb5cc09726.slice/crio-6f7d6fc990ab3d153b0746fbe093514dc0cfb23fbff7eea7466ff1fd41ed4162 WatchSource:0}: Error finding container 6f7d6fc990ab3d153b0746fbe093514dc0cfb23fbff7eea7466ff1fd41ed4162: Status 404 returned error can't find the container with id 6f7d6fc990ab3d153b0746fbe093514dc0cfb23fbff7eea7466ff1fd41ed4162 Jul 08 19:34:46.441264 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:34:46.441043 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6512e99_de0c_4f7b_804d_231b6f38ac55.slice/crio-13d9a9968a92a71a90e43396edac7e0327edb9cc5f9bdabdbdbe8db4a33ab461 WatchSource:0}: Error finding container 13d9a9968a92a71a90e43396edac7e0327edb9cc5f9bdabdbdbe8db4a33ab461: Status 404 returned error can't find the container with id 13d9a9968a92a71a90e43396edac7e0327edb9cc5f9bdabdbdbe8db4a33ab461 Jul 08 19:34:46.542015 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.541843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:46.542157 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.542081 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:46.549358 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.549328 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9r2s" event={"ID":"d6512e99-de0c-4f7b-804d-231b6f38ac55","Type":"ContainerStarted","Data":"13d9a9968a92a71a90e43396edac7e0327edb9cc5f9bdabdbdbe8db4a33ab461"} Jul 08 19:34:46.550366 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.550343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerStarted","Data":"b3eb1e8d61ef4b125edc69c16002ba415ee571c3cbfd427eabbdedec7be1f54e"} Jul 08 19:34:46.551395 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.551370 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" event={"ID":"77248c84-f6c8-44ef-93ea-8f1943e063ef","Type":"ContainerStarted","Data":"7fc237f898eb75c4d8deda2b3acfc16858c858724d579e1e1be1ecb8e7de8660"} Jul 08 19:34:46.552556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.552536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" event={"ID":"7bf4fd49-4b94-469f-9c93-64accc80e6d7","Type":"ContainerStarted","Data":"bafb8d79757ca9058a84140e1eff49b1f667bc3a4660c35e600a2a9e54fd5cac"} Jul 08 19:34:46.553626 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.553605 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-57sf7" event={"ID":"4939a718-e97c-4533-8ff3-90eb5cc09726","Type":"ContainerStarted","Data":"6f7d6fc990ab3d153b0746fbe093514dc0cfb23fbff7eea7466ff1fd41ed4162"} Jul 08 19:34:46.554646 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.554625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pn57x" event={"ID":"44a97c13-4c66-40f6-b7fc-0898c34e0e6d","Type":"ContainerStarted","Data":"6216089b9bad337c0daa7463dd181818eb41698d9fac4e2120fdd697f13215c9"} Jul 08 19:34:46.555715 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.555694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjphv" event={"ID":"99a02fe3-c467-4503-9cdd-05aa38c92b38","Type":"ContainerStarted","Data":"7ac0e523b5d17a7458ec68b043e0c2703e93f9375af19c9f99fd17acfac26632"} Jul 08 19:34:46.560772 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.560747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"5f933ba5b53d93018c45b920dcd306d8021d8f0bcb55f038717963866feefa8b"} Jul 08 19:34:46.562530 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.562510 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wrtb2" event={"ID":"53dbc076-851f-4a17-9168-2d1541534b26","Type":"ContainerStarted","Data":"06049f18b55078d97b2dd1e5412b7f5f77f6640baa5ff0f29d4eb04d3db2bcd1"} Jul 08 19:34:46.564329 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.564162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" event={"ID":"9a0bc436887006b5401efbd37faaf404","Type":"ContainerStarted","Data":"5c781d9869166df4ac84e6bd332387949d2ef708ce95c48bfefec05fb35b1bc7"} Jul 08 19:34:46.990470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.990379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:46.990470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:46.990439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:46.990682 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990641 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:46.990682 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990665 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:46.990682 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990678 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:46.990828 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:48.990720087 +0000 UTC m=+5.978523938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:46.990828 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990816 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:46.990948 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:46.990861 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:48.990849702 +0000 UTC m=+5.978653558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:47.093861 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.093827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:47.094040 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:47.093993 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:47.094119 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:47.094058 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:34:49.094038198 +0000 UTC m=+6.081842048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:47.422423 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.422229 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:29:45 +0000 UTC" deadline="2028-01-28 02:21:50.445746904 +0000 UTC" Jul 08 19:34:47.422423 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.422294 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13638h47m3.02345693s" Jul 08 19:34:47.549124 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.549094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:47.549318 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:47.549235 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:47.549734 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.549715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:47.549848 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:47.549828 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:47.586381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.585988 2559 generic.go:356] "Generic (PLEG): container finished" podID="e2b7727f0a6dbd3ca58ac02e8e3805c8" containerID="b7336971dfd7d0c9ba636b46c174139dc26d526b7b28d795ed4c3a1842bacd24" exitCode=0 Jul 08 19:34:47.586381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.586081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" event={"ID":"e2b7727f0a6dbd3ca58ac02e8e3805c8","Type":"ContainerDied","Data":"b7336971dfd7d0c9ba636b46c174139dc26d526b7b28d795ed4c3a1842bacd24"} Jul 08 19:34:47.603439 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:47.603385 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-119.ec2.internal" podStartSLOduration=3.603365442 podStartE2EDuration="3.603365442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:34:46.579209217 +0000 UTC m=+3.567013089" watchObservedRunningTime="2026-07-08 19:34:47.603365442 +0000 UTC m=+4.591169313" Jul 08 19:34:48.542217 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:48.542165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:48.542864 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:48.542320 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:48.602723 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:48.602001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" event={"ID":"e2b7727f0a6dbd3ca58ac02e8e3805c8","Type":"ContainerStarted","Data":"295aa975c1995935e61f2a8c11217af23c616f78bc8ba28287e23e67173722f0"} Jul 08 19:34:48.618659 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:48.618582 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-119.ec2.internal" podStartSLOduration=4.618558788 podStartE2EDuration="4.618558788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:34:48.617637731 +0000 UTC m=+5.605441601" watchObservedRunningTime="2026-07-08 19:34:48.618558788 +0000 UTC m=+5.606362663" Jul 08 19:34:49.010748 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:49.010705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:49.010932 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:49.010775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:49.010997 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.010957 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:49.010997 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.010978 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:49.010997 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.010992 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:49.011149 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.011061 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:53.011041393 +0000 UTC m=+9.998845246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:49.012040 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.011464 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:49.012040 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.011515 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:53.011500591 +0000 UTC m=+9.999304442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:49.112547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:49.111879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:49.112547 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.112044 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:49.112547 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.112109 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:34:53.112090285 +0000 UTC m=+10.099894149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:49.542247 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:49.542210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:49.542679 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.542343 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:49.542729 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:49.542711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:49.542840 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:49.542809 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:50.542046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:50.541999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:50.542261 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:50.542145 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:51.546108 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:51.546077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:51.546576 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:51.546200 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:51.546576 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:51.546209 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:51.546576 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:51.546324 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:52.542435 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:52.542402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:52.542600 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:52.542535 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:53.043510 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:53.043469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:53.043939 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:53.043529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:53.043939 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.043664 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:53.043939 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.043684 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:53.043939 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.043696 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:53.043939 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.043750 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:35:01.043732499 +0000 UTC m=+18.031536351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:53.044210 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.044139 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:53.044210 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.044201 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:35:01.044168559 +0000 UTC m=+18.031972415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:53.145220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:53.144692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:53.145220 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.144825 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:53.145220 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.144885 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:35:01.14486571 +0000 UTC m=+18.132669570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:53.542053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:53.542025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:53.542268 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.542127 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:53.542565 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:53.542538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:53.542688 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:53.542667 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:54.542109 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:54.542020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:54.542537 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:54.542154 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:55.542554 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:55.541857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:55.542554 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:55.542153 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:55.543047 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:55.542639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:55.543047 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:55.542726 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:56.542275 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:56.542240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:56.542460 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:56.542355 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:57.542008 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:57.541975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:57.542463 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:57.542117 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:57.542523 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:57.542510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:57.542616 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:57.542596 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:34:58.541875 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:58.541845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:34:58.542053 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:58.541980 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:34:59.541710 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:59.541679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:34:59.541861 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:59.541824 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:34:59.541936 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:34:59.541909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:34:59.542032 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:34:59.542010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:00.542669 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:00.542631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:00.543111 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:00.542759 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:01.106861 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:01.106832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:01.107036 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:01.106889 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:01.107036 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.106984 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:01.107036 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.107001 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:35:01.107036 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.107027 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:35:01.107036 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.107037 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:01.107201 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.107043 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:35:17.107028827 +0000 UTC m=+34.094832676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:01.107201 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.107074 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:35:17.107063081 +0000 UTC m=+34.094866930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:01.208054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:01.208017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:01.208246 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.208146 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:01.208246 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.208238 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:35:17.208218271 +0000 UTC m=+34.196022126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:01.542095 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:01.542055 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:01.542095 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:01.542095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:01.542346 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.542209 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:01.542404 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:01.542357 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:02.542313 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:02.542279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:02.542760 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:02.542401 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:03.542841 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:03.542810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:03.543315 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:03.542918 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:03.543315 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:03.543009 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:03.543315 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:03.543141 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:04.542157 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:04.542117 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:04.542372 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:04.542272 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:05.544839 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.544478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:05.544839 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:05.544815 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:05.545378 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.545211 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:05.545378 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:05.545301 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:05.637259 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.637220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9r2s" event={"ID":"d6512e99-de0c-4f7b-804d-231b6f38ac55","Type":"ContainerStarted","Data":"4d779faabf7686c2ed2871d1b357c9e1456a70e4080713b910b2cef9d619c886"} Jul 08 19:35:05.639201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.639136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerStarted","Data":"ebc6f4e3298ba8e48243ff72aa5b5af6f1de51a2f6887a6fe6bc1ad9624b9efb"} Jul 08 19:35:05.641094 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.641068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" event={"ID":"77248c84-f6c8-44ef-93ea-8f1943e063ef","Type":"ContainerStarted","Data":"b41bc3195b662705aed75ac5b359954d0fdd82f6e3703de4cb7ff480ea533bd6"} Jul 08 19:35:05.642685 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.642514 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" event={"ID":"7bf4fd49-4b94-469f-9c93-64accc80e6d7","Type":"ContainerStarted","Data":"9d8fbae7ab74fd9c09831354c650d00ca05e875ca5b28593381db799411704bd"} Jul 08 19:35:05.644429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.644399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-57sf7" event={"ID":"4939a718-e97c-4533-8ff3-90eb5cc09726","Type":"ContainerStarted","Data":"220f37b5c99ddb63ad7588cc0182743f0846f04fbac54a72cd4ba2b34332ad05"} Jul 08 19:35:05.646339 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.646314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pn57x" event={"ID":"44a97c13-4c66-40f6-b7fc-0898c34e0e6d","Type":"ContainerStarted","Data":"4f389a02e6c0d2c420f362d5705c46cb12d55671671d064f62973f42313e2892"} Jul 08 19:35:05.648216 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.648125 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjphv" event={"ID":"99a02fe3-c467-4503-9cdd-05aa38c92b38","Type":"ContainerStarted","Data":"3d26222506ae5b9569afdaa6e94b0547d99714b096880fe593e6b1e0ec3f8c4b"} Jul 08 19:35:05.650084 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.649980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"4a60488f00c512373b70aa05bded50de55d9abd4d229f7a42edd96cc85a54c5f"} Jul 08 19:35:05.659669 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.659466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n9r2s" podStartSLOduration=3.6825926 podStartE2EDuration="22.658880515s" totalImagesPullingTime="18.976287915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.658416081 +0000 UTC m=+22.646219992" watchObservedRunningTime="2026-07-08 19:35:05.658880515 +0000 UTC m=+22.646684389" Jul 08 19:35:05.676734 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.676680 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-57sf7" podStartSLOduration=11.958310591 podStartE2EDuration="22.676665917s" totalImagesPullingTime="10.718355326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.676495438 +0000 UTC m=+22.664299310" watchObservedRunningTime="2026-07-08 19:35:05.676665917 +0000 UTC m=+22.664469787" Jul 08 19:35:05.692403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.692356 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mjphv" podStartSLOduration=11.96822413 podStartE2EDuration="22.692339782s" totalImagesPullingTime="10.724115652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.691872954 +0000 UTC m=+22.679676826" watchObservedRunningTime="2026-07-08 19:35:05.692339782 +0000 UTC m=+22.680143650" Jul 08 19:35:05.738729 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.738653 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d5b7n" podStartSLOduration=3.8066466009999997 podStartE2EDuration="22.738631032s" totalImagesPullingTime="18.931984431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.737844112 +0000 UTC m=+22.725647983" watchObservedRunningTime="2026-07-08 19:35:05.738631032 +0000 UTC m=+22.726434904" Jul 08 19:35:05.757040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.756985 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pn57x" podStartSLOduration=3.836969991 podStartE2EDuration="22.756971963s" totalImagesPullingTime="18.920001972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.756703156 +0000 UTC m=+22.744507028" watchObservedRunningTime="2026-07-08 19:35:05.756971963 +0000 UTC m=+22.744775834" Jul 08 19:35:05.792555 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.792511 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:05.857375 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.857352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:05.956953 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:05.956930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:06.541931 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.541898 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:06.542109 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:06.542013 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:06.653632 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.653560 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="ebc6f4e3298ba8e48243ff72aa5b5af6f1de51a2f6887a6fe6bc1ad9624b9efb" exitCode=0 Jul 08 19:35:06.654308 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.653647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"ebc6f4e3298ba8e48243ff72aa5b5af6f1de51a2f6887a6fe6bc1ad9624b9efb"} Jul 08 19:35:06.656779 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.656753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"84a315947addb33e9e94aebc61e6be82000b765c327a7b5e0afc224fa8a98439"} Jul 08 19:35:06.656871 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.656824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"da4be7eeba6727f0de81be542204cd221f252e1facbd40b53d45c4d36951912a"} Jul 08 19:35:06.656871 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.656856 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"8dcffce3fd73aefe6dce09cedb50e105b056d2144c724a489dd4c3b8c5f42d39"} Jul 08 19:35:06.656960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.656885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"96cd1410bf1fcc6ef0ffe89c0187b5d94dfec5e0a59555a459e202167eb687b9"} Jul 08 19:35:06.656960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:06.656912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"d392c5f219b716924d4ab553b05ebd0465bd1eda73307f5ef339340ce29d3da3"} Jul 08 19:35:07.146971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.146941 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:35:07.427207 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.427022 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:35:07.146966841Z","UUID":"7d085000-90b1-41cd-9175-658ebac340db","Handler":null,"Name":"","Endpoint":""} Jul 08 19:35:07.428441 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.428426 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:35:07.428527 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.428463 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:35:07.541788 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.541748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:07.541959 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.541748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:07.541959 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:07.541879 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:07.541959 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:07.541941 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:07.660281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.660250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" event={"ID":"77248c84-f6c8-44ef-93ea-8f1943e063ef","Type":"ContainerStarted","Data":"af6f74e1f2e45f31e2ba78c4d0ae01c17bc6dfeec40a9267c0da3ed26a46263e"} Jul 08 19:35:07.661494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.661470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wrtb2" event={"ID":"53dbc076-851f-4a17-9168-2d1541534b26","Type":"ContainerStarted","Data":"b3ebb87ca96f27d5bd3f55914021020e5d5707e7fec48162847f48a434fb345e"} Jul 08 19:35:07.677873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.677792 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wrtb2" podStartSLOduration=5.745144271 podStartE2EDuration="24.677778752s" totalImagesPullingTime="18.932634481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:07.677226088 +0000 UTC m=+24.665029949" watchObservedRunningTime="2026-07-08 19:35:07.677778752 +0000 UTC m=+24.665582623" Jul 08 19:35:07.796345 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.796305 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:07.865690 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:07.865657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:08.542510 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:08.542485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:08.542708 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:08.542568 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:08.667559 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:08.667469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"54b1aad46aae414920c18a72cc1a6cda6f9f0c3793a2c0f3a0c1fbb1b20206d7"} Jul 08 19:35:08.669888 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:08.669864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" event={"ID":"77248c84-f6c8-44ef-93ea-8f1943e063ef","Type":"ContainerStarted","Data":"55621b0008b8a0099c5ee3ceeb91e4bc177f5f532fc2e8089aec6c2872a54a41"} Jul 08 19:35:08.688742 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:08.688700 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt48f" podStartSLOduration=4.257797704 podStartE2EDuration="25.68868653s" totalImagesPullingTime="21.430888826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:08.688414282 +0000 UTC m=+25.676218154" watchObservedRunningTime="2026-07-08 19:35:08.68868653 +0000 UTC m=+25.676490401" Jul 08 19:35:09.542446 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:09.542242 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:09.542625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:09.542333 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:09.542625 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:09.542543 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:09.542625 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:09.542611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:10.330852 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.330826 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:35:10.332110 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.332088 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:35:10.542194 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.542159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:10.542376 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:10.542305 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:10.679044 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.678919 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" event={"ID":"84ff4ed4-11e3-4ee1-95ea-6f82e1396a79","Type":"ContainerStarted","Data":"5faa282da96ffafbac91ce4fd61c4e64fa69abf050fff3a4b5d1547f2ed0dccd"} Jul 08 19:35:10.679517 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.679492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:35:10.680010 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.679992 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mjphv" Jul 08 19:35:10.710648 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.710608 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" podStartSLOduration=8.717248723 podStartE2EDuration="27.710594162s" totalImagesPullingTime="18.993345439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:10.710120467 +0000 UTC m=+27.697924339" watchObservedRunningTime="2026-07-08 19:35:10.710594162 +0000 UTC m=+27.698398033" Jul 08 19:35:10.800893 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:10.800824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:11.542222 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.541856 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:11.542222 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.541865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:11.542785 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:11.542340 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:11.542785 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:11.542468 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:11.682757 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.682724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:11.682923 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.682813 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:11.682923 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.682861 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:11.699717 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.699691 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:11.700330 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:11.700309 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:12.542141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.542100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:12.542341 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:12.542259 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:12.617527 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.617489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b7nn"] Jul 08 19:35:12.617686 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.617565 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k6q7x"] Jul 08 19:35:12.617686 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.617649 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:12.617762 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:12.617737 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:12.618087 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.618071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:12.618189 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:12.618162 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:12.630609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.630569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-755zf"] Jul 08 19:35:12.683723 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:12.683633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:12.683876 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:12.683763 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:13.239778 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:13.239739 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.340010 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:13.339973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.540413 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:13.540370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.645381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:13.645299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.410194 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.410147 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.511300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.511118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.542539 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.542505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:14.542711 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.542602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:14.542711 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:14.542611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:14.542711 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:14.542695 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:14.542894 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.542738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:14.542894 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:14.542798 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:14.689057 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.689027 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="76d96269fae28f90cc07b98f0ddb471ec81af8d4ce830f30b961d087ce5537e5" exitCode=0 Jul 08 19:35:14.689429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:14.689088 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"76d96269fae28f90cc07b98f0ddb471ec81af8d4ce830f30b961d087ce5537e5"} Jul 08 19:35:15.693851 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:15.693761 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="dbae3e2ecb727b467dbd1fc504232b907137c7c4bbc369527b8ac8b07cf2d9f0" exitCode=0 Jul 08 19:35:15.693851 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:15.693832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"dbae3e2ecb727b467dbd1fc504232b907137c7c4bbc369527b8ac8b07cf2d9f0"} Jul 08 19:35:16.542640 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.542612 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:16.542744 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.542616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:16.542793 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:16.542753 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:35:16.542881 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.542621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:16.543189 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:16.542841 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k6q7x" podUID="cac5a3b2-c7d5-4e75-96f8-7261ae76c23d" Jul 08 19:35:16.543189 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:16.542937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-755zf" podUID="e575239b-2bc0-4d4b-bca5-cea88e401d80" Jul 08 19:35:16.698306 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.698225 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="27161f7c0c021d3cb1b9cca6d73dc8853cc51520517d64def3c402f6183f1817" exitCode=0 Jul 08 19:35:16.698306 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.698284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"27161f7c0c021d3cb1b9cca6d73dc8853cc51520517d64def3c402f6183f1817"} Jul 08 19:35:16.792223 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:16.792156 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:17.127062 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:17.127025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:17.127071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127161 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127214 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127227 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127237 2559 projected.go:196] Error preparing data for projected volume kube-api-access-mwj6j for pod openshift-network-diagnostics/network-check-target-k6q7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:17.127258 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127242 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret podName:e575239b-2bc0-4d4b-bca5-cea88e401d80 nodeName:}" failed. No retries permitted until 2026-07-08 19:35:49.12722566 +0000 UTC m=+66.115029513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret") pod "global-pull-secret-syncer-755zf" (UID: "e575239b-2bc0-4d4b-bca5-cea88e401d80") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:17.127434 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.127275 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j podName:cac5a3b2-c7d5-4e75-96f8-7261ae76c23d nodeName:}" failed. No retries permitted until 2026-07-08 19:35:49.127262766 +0000 UTC m=+66.115066615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mwj6j" (UniqueName: "kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j") pod "network-check-target-k6q7x" (UID: "cac5a3b2-c7d5-4e75-96f8-7261ae76c23d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:17.228321 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:17.228285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:17.228494 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.228471 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:17.228574 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:17.228548 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:35:49.228531692 +0000 UTC m=+66.216335540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:18.352739 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.352710 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-119.ec2.internal" event="NodeReady" Jul 08 19:35:18.353321 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.352851 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:35:18.399234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.399198 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-82fkw"] Jul 08 19:35:18.401224 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.401202 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.404489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.404379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:35:18.404871 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.404854 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6zdff\"" Jul 08 19:35:18.405034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.405014 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:35:18.405363 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.405335 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gld2j"] Jul 08 19:35:18.407042 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.407023 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.410610 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.410216 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:35:18.410610 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.410302 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnmhm\"" Jul 08 19:35:18.410610 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.410216 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:35:18.410610 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.410454 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:35:18.412810 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.412791 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82fkw"] Jul 08 19:35:18.416218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.416199 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gld2j"] Jul 08 19:35:18.445759 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.445728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:18.541135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cba8a16-6b11-4417-8476-92eb6b69903b-tmp-dir\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.541314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cba8a16-6b11-4417-8476-92eb6b69903b-config-volume\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.541314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a040575-7104-450c-b6f8-2505a0bd3cd1-cert\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.541314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqzbw\" (UniqueName: \"kubernetes.io/projected/4a040575-7104-450c-b6f8-2505a0bd3cd1-kube-api-access-qqzbw\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.541314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtsbq\" (UniqueName: \"kubernetes.io/projected/6cba8a16-6b11-4417-8476-92eb6b69903b-kube-api-access-dtsbq\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.541495 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.541329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.542145 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.542124 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:18.542232 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.542154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:18.542284 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.542126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:18.545192 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545156 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:35:18.545292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545253 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:35:18.545292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:35:18.545379 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545164 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:35:18.545417 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545163 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6785\"" Jul 08 19:35:18.545457 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545447 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljxhr\"" Jul 08 19:35:18.546001 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.545953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:18.598234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.598201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:18.641887 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.641800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cba8a16-6b11-4417-8476-92eb6b69903b-tmp-dir\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.641887 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.641845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cba8a16-6b11-4417-8476-92eb6b69903b-config-volume\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.642051 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.641992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a040575-7104-450c-b6f8-2505a0bd3cd1-cert\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.642051 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.642027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqzbw\" (UniqueName: \"kubernetes.io/projected/4a040575-7104-450c-b6f8-2505a0bd3cd1-kube-api-access-qqzbw\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.642114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.642073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtsbq\" (UniqueName: \"kubernetes.io/projected/6cba8a16-6b11-4417-8476-92eb6b69903b-kube-api-access-dtsbq\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.642164 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.642143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cba8a16-6b11-4417-8476-92eb6b69903b-tmp-dir\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.642305 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.642285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.642408 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:18.642384 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:18.642452 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:18.642446 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:19.142430127 +0000 UTC m=+36.130233989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:18.642452 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.642440 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cba8a16-6b11-4417-8476-92eb6b69903b-config-volume\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.646259 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.646237 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a040575-7104-450c-b6f8-2505a0bd3cd1-cert\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.652024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.652000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtsbq\" (UniqueName: \"kubernetes.io/projected/6cba8a16-6b11-4417-8476-92eb6b69903b-kube-api-access-dtsbq\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:18.652141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.652104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqzbw\" (UniqueName: \"kubernetes.io/projected/4a040575-7104-450c-b6f8-2505a0bd3cd1-kube-api-access-qqzbw\") pod \"ingress-canary-gld2j\" (UID: \"4a040575-7104-450c-b6f8-2505a0bd3cd1\") " pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.723001 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.722968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gld2j" Jul 08 19:35:18.879618 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:18.879438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gld2j"] Jul 08 19:35:18.883577 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:35:18.883551 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a040575_7104_450c_b6f8_2505a0bd3cd1.slice/crio-b09195b2e71e913a83342b062acdb98855f7c059712acbc3f195445c4032d4b5 WatchSource:0}: Error finding container b09195b2e71e913a83342b062acdb98855f7c059712acbc3f195445c4032d4b5: Status 404 returned error can't find the container with id b09195b2e71e913a83342b062acdb98855f7c059712acbc3f195445c4032d4b5 Jul 08 19:35:19.144417 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:19.144382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:19.144672 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:19.144563 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:19.144672 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:19.144650 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:20.144626079 +0000 UTC m=+37.132429952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:19.706874 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:19.706807 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gld2j" event={"ID":"4a040575-7104-450c-b6f8-2505a0bd3cd1","Type":"ContainerStarted","Data":"b09195b2e71e913a83342b062acdb98855f7c059712acbc3f195445c4032d4b5"} Jul 08 19:35:20.150672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:20.150635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:20.154696 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:20.154673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:20.155279 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:20.155085 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:20.155400 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:20.155342 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:22.155322143 +0000 UTC m=+39.143125997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:20.249974 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:20.249939 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:22.169075 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:22.169035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:22.169514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:22.169226 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:22.169514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:22.169302 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:26.169283991 +0000 UTC m=+43.157087860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:23.362241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.362050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:23.424330 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.424284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:23.717168 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.717086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gld2j" event={"ID":"4a040575-7104-450c-b6f8-2505a0bd3cd1","Type":"ContainerStarted","Data":"e3e1de8322a6cb5c21083d44383e09c55ba12a5e4ff6103e842b8a404f087687"} Jul 08 19:35:23.719675 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.719649 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="e4d4d9fad3cf8273319935ab166c4ced44374676e1c04fbb99d04cdf3395114a" exitCode=0 Jul 08 19:35:23.719807 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.719681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"e4d4d9fad3cf8273319935ab166c4ced44374676e1c04fbb99d04cdf3395114a"} Jul 08 19:35:23.734614 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:23.734568 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gld2j" podStartSLOduration=1.8386361930000001 podStartE2EDuration="5.734554538s" totalImagesPullingTime="3.895918345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:23.733861532 +0000 UTC m=+40.721665404" watchObservedRunningTime="2026-07-08 19:35:23.734554538 +0000 UTC m=+40.722358409" Jul 08 19:35:24.724560 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:24.724516 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9c14c52-a3bc-4850-b500-3fac7a15f33e" containerID="908eaad4529bff69ea55a87f2c93ef4431ff6582c4d0870c9bebca8e3796f0ae" exitCode=0 Jul 08 19:35:24.725003 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:24.724609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerDied","Data":"908eaad4529bff69ea55a87f2c93ef4431ff6582c4d0870c9bebca8e3796f0ae"} Jul 08 19:35:25.730667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:25.730633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" event={"ID":"b9c14c52-a3bc-4850-b500-3fac7a15f33e","Type":"ContainerStarted","Data":"67f28d6dc18534bc6ea98607958c49a0f1d4cffa4276ebd84744d4c5fe2b8056"} Jul 08 19:35:25.755581 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:25.755524 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cb2rm" podStartSLOduration=9.340407269 podStartE2EDuration="42.75550544s" totalImagesPullingTime="33.415098171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:25.753420901 +0000 UTC m=+42.741224805" watchObservedRunningTime="2026-07-08 19:35:25.75550544 +0000 UTC m=+42.743309310" Jul 08 19:35:25.876326 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:25.876291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:25.938302 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:25.938264 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:26.202407 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:26.202368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:26.202591 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:26.202539 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:26.202653 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:26.202618 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:34.202595144 +0000 UTC m=+51.190399009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:30.467682 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:30.467647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:30.536202 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:30.536159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:34.257434 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:34.257397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:34.257838 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:34.257534 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:34.257838 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:34.257602 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:50.257587493 +0000 UTC m=+67.245391346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:39.103512 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:39.103477 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:39.201951 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:39.201920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:43.705159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:43.705135 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8cg2d" Jul 08 19:35:43.859881 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:43.859855 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:43.921215 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:43.921188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:49.164601 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.164560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:49.164601 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.164607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:49.168141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.168124 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:35:49.168218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.168168 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:35:49.177994 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.177974 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:35:49.179412 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.179394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e575239b-2bc0-4d4b-bca5-cea88e401d80-original-pull-secret\") pod \"global-pull-secret-syncer-755zf\" (UID: \"e575239b-2bc0-4d4b-bca5-cea88e401d80\") " pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:49.188411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.188393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwj6j\" (UniqueName: \"kubernetes.io/projected/cac5a3b2-c7d5-4e75-96f8-7261ae76c23d-kube-api-access-mwj6j\") pod \"network-check-target-k6q7x\" (UID: \"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d\") " pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:49.265682 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.265630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:35:49.268307 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.268287 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:35:49.276715 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:49.276694 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:35:49.276797 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:49.276762 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:36:53.276739121 +0000 UTC m=+130.264542971 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : secret "metrics-daemon-secret" not found Jul 08 19:35:49.460959 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.460878 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-755zf" Jul 08 19:35:49.468827 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.468807 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljxhr\"" Jul 08 19:35:49.476220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.476167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:49.595625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.595595 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-755zf"] Jul 08 19:35:49.598781 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:35:49.598751 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode575239b_2bc0_4d4b_bca5_cea88e401d80.slice/crio-774f6f4fd39a55a3ada233cf8fd81d1c25363add0f18ec6ff97e9281e940f55d WatchSource:0}: Error finding container 774f6f4fd39a55a3ada233cf8fd81d1c25363add0f18ec6ff97e9281e940f55d: Status 404 returned error can't find the container with id 774f6f4fd39a55a3ada233cf8fd81d1c25363add0f18ec6ff97e9281e940f55d Jul 08 19:35:49.611421 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.611402 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k6q7x"] Jul 08 19:35:49.614065 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:35:49.614041 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac5a3b2_c7d5_4e75_96f8_7261ae76c23d.slice/crio-f2d091b7b758b4c18014c872089d7f4854afe4388d52fe27e80f4ee46c06a07b WatchSource:0}: Error finding container f2d091b7b758b4c18014c872089d7f4854afe4388d52fe27e80f4ee46c06a07b: Status 404 returned error can't find the container with id f2d091b7b758b4c18014c872089d7f4854afe4388d52fe27e80f4ee46c06a07b Jul 08 19:35:49.790653 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.790623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-755zf" event={"ID":"e575239b-2bc0-4d4b-bca5-cea88e401d80","Type":"ContainerStarted","Data":"774f6f4fd39a55a3ada233cf8fd81d1c25363add0f18ec6ff97e9281e940f55d"} Jul 08 19:35:49.791648 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:49.791623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k6q7x" event={"ID":"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d","Type":"ContainerStarted","Data":"f2d091b7b758b4c18014c872089d7f4854afe4388d52fe27e80f4ee46c06a07b"} Jul 08 19:35:50.272291 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:50.272249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:35:50.272707 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:50.272419 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:50.272707 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:35:50.272536 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:36:22.272466508 +0000 UTC m=+99.260270359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:54.806211 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:54.806151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k6q7x" event={"ID":"cac5a3b2-c7d5-4e75-96f8-7261ae76c23d","Type":"ContainerStarted","Data":"e48ecdd2eeed06b076fd178e95e79dea9a9c2322eb10634b5eb3dc602458c6c1"} Jul 08 19:35:54.806726 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:54.806243 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:35:54.807681 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:54.807649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-755zf" event={"ID":"e575239b-2bc0-4d4b-bca5-cea88e401d80","Type":"ContainerStarted","Data":"87c79b3c8cb69078dad1a5cde0b3568428ae9474b5fef157bb6e31058bd215c9"} Jul 08 19:35:54.822481 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:54.822429 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k6q7x" podStartSLOduration=67.010318282 podStartE2EDuration="1m11.822417899s" totalImagesPullingTime="4.812099617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:54.82219823 +0000 UTC m=+71.810002100" watchObservedRunningTime="2026-07-08 19:35:54.822417899 +0000 UTC m=+71.810221805" Jul 08 19:35:54.839902 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:35:54.839848 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-755zf" podStartSLOduration=67.009532416 podStartE2EDuration="1m11.839830856s" totalImagesPullingTime="4.83029844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:54.839410194 +0000 UTC m=+71.827214081" watchObservedRunningTime="2026-07-08 19:35:54.839830856 +0000 UTC m=+71.827634705" Jul 08 19:36:22.284837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:36:22.284804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:36:22.285268 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:36:22.284912 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:36:22.285268 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:36:22.284966 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:37:26.284952507 +0000 UTC m=+163.272756356 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:36:25.811830 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:36:25.811799 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k6q7x" Jul 08 19:36:31.550122 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:36:31.550088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:36:53.283579 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:36:53.283538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:36:53.284139 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:36:53.283699 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:36:53.284139 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:36:53.283798 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.283774376 +0000 UTC m=+252.271578228 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : secret "metrics-daemon-secret" not found Jul 08 19:37:21.416874 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:37:21.416828 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-82fkw" podUID="6cba8a16-6b11-4417-8476-92eb6b69903b" Jul 08 19:37:21.553731 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:37:21.553690 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:37:22.011619 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:37:22.011593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82fkw" Jul 08 19:37:26.310828 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:37:26.310779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:37:26.311284 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:37:26.310935 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:37:26.311284 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:37:26.311013 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls podName:6cba8a16-6b11-4417-8476-92eb6b69903b nodeName:}" failed. No retries permitted until 2026-07-08 19:39:28.310996828 +0000 UTC m=+285.298800677 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls") pod "dns-default-82fkw" (UID: "6cba8a16-6b11-4417-8476-92eb6b69903b") : secret "dns-default-metrics-tls" not found Jul 08 19:37:34.542685 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:37:34.542588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:38:06.939539 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:06.939502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:47.805867 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.805833 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q"] Jul 08 19:38:47.807706 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.807689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.808969 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.808941 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw"] Jul 08 19:38:47.810466 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.810450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q2hrb\"" Jul 08 19:38:47.810721 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.810707 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bcdc55579-xpxfj"] Jul 08 19:38:47.810834 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.810821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.812396 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.812382 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.816316 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816285 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816361 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816316 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816397 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816368 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.816420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 19:38:47.816777 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816295 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 19:38:47.816777 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816513 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 19:38:47.816777 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816576 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.816777 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dcqxj\"" Jul 08 19:38:47.816777 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816683 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6llrs\"" Jul 08 19:38:47.817003 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816800 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 19:38:47.817003 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816840 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.817003 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.816954 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.836323 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.836302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q"] Jul 08 19:38:47.836999 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.836981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw"] Jul 08 19:38:47.841027 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.841004 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bcdc55579-xpxfj"] Jul 08 19:38:47.863046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fdad0506-1bc8-4076-9519-546cc4283fe7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.863151 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.863151 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/198a965e-f984-442f-9c85-89ab02f4489e-config\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.863151 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbpz\" (UniqueName: \"kubernetes.io/projected/198a965e-f984-442f-9c85-89ab02f4489e-kube-api-access-4xbpz\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.863151 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-default-certificate\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.863393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9hx\" (UniqueName: \"kubernetes.io/projected/ffb6e633-7590-4ffa-8891-b53297bcc0a6-kube-api-access-mc9hx\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.863393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/198a965e-f984-442f-9c85-89ab02f4489e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.863393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-stats-auth\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.863393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.863556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.863556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.863445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lh5z\" (UniqueName: \"kubernetes.io/projected/fdad0506-1bc8-4076-9519-546cc4283fe7-kube-api-access-6lh5z\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.892000 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.891975 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7"] Jul 08 19:38:47.893705 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.893689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" Jul 08 19:38:47.896903 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.896884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.897675 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.897660 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hrmxf\"" Jul 08 19:38:47.897756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.897662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.907797 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.907778 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7"] Jul 08 19:38:47.964378 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/198a965e-f984-442f-9c85-89ab02f4489e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.964488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-stats-auth\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.964488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.964488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.964488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lh5z\" (UniqueName: \"kubernetes.io/projected/fdad0506-1bc8-4076-9519-546cc4283fe7-kube-api-access-6lh5z\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.964488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fdad0506-1bc8-4076-9519-546cc4283fe7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf64x\" (UniqueName: \"kubernetes.io/projected/62b6fe70-e8ef-48ab-bc49-4d41db755481-kube-api-access-gf64x\") pod \"volume-data-source-validator-5d456fdbcd-5ltj7\" (UID: \"62b6fe70-e8ef-48ab-bc49-4d41db755481\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:47.964542 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:47.964544 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:48.464523075 +0000 UTC m=+245.452326938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:47.964625 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:48.464607773 +0000 UTC m=+245.452411632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : secret "router-metrics-certs-default" not found Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/198a965e-f984-442f-9c85-89ab02f4489e-config\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.964733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbpz\" (UniqueName: \"kubernetes.io/projected/198a965e-f984-442f-9c85-89ab02f4489e-kube-api-access-4xbpz\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.965094 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:47.964739 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:47.965094 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-default-certificate\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.965094 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:47.964790 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:48.464778797 +0000 UTC m=+245.452582649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:47.965094 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.964831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9hx\" (UniqueName: \"kubernetes.io/projected/ffb6e633-7590-4ffa-8891-b53297bcc0a6-kube-api-access-mc9hx\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.965326 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.965281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fdad0506-1bc8-4076-9519-546cc4283fe7-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.965387 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.965368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/198a965e-f984-442f-9c85-89ab02f4489e-config\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.967292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.967273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/198a965e-f984-442f-9c85-89ab02f4489e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.967370 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.967331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-default-certificate\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.967450 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.967429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-stats-auth\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:47.975683 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.975657 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbpz\" (UniqueName: \"kubernetes.io/projected/198a965e-f984-442f-9c85-89ab02f4489e-kube-api-access-4xbpz\") pod \"service-ca-operator-5d46d9ffd4-tqscw\" (UID: \"198a965e-f984-442f-9c85-89ab02f4489e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:47.975779 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.975703 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lh5z\" (UniqueName: \"kubernetes.io/projected/fdad0506-1bc8-4076-9519-546cc4283fe7-kube-api-access-6lh5z\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:47.975942 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:47.975923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9hx\" (UniqueName: \"kubernetes.io/projected/ffb6e633-7590-4ffa-8891-b53297bcc0a6-kube-api-access-mc9hx\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:48.053754 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.053728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:48.065793 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.065738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf64x\" (UniqueName: \"kubernetes.io/projected/62b6fe70-e8ef-48ab-bc49-4d41db755481-kube-api-access-gf64x\") pod \"volume-data-source-validator-5d456fdbcd-5ltj7\" (UID: \"62b6fe70-e8ef-48ab-bc49-4d41db755481\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" Jul 08 19:38:48.074323 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.074298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf64x\" (UniqueName: \"kubernetes.io/projected/62b6fe70-e8ef-48ab-bc49-4d41db755481-kube-api-access-gf64x\") pod \"volume-data-source-validator-5d456fdbcd-5ltj7\" (UID: \"62b6fe70-e8ef-48ab-bc49-4d41db755481\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" Jul 08 19:38:48.123315 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.123294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" Jul 08 19:38:48.155628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.155604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:48.202482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.202458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" Jul 08 19:38:48.244076 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.244053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw"] Jul 08 19:38:48.246395 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:38:48.246369 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198a965e_f984_442f_9c85_89ab02f4489e.slice/crio-b15c1b84905ae8f36cd211b5be86f46aeabf498b74fdc8f982e16d6c3f2f22fb WatchSource:0}: Error finding container b15c1b84905ae8f36cd211b5be86f46aeabf498b74fdc8f982e16d6c3f2f22fb: Status 404 returned error can't find the container with id b15c1b84905ae8f36cd211b5be86f46aeabf498b74fdc8f982e16d6c3f2f22fb Jul 08 19:38:48.332421 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.332362 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7"] Jul 08 19:38:48.335038 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:38:48.335014 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b6fe70_e8ef_48ab_bc49_4d41db755481.slice/crio-db8a1fb0cfecbac5be30fad56d50a5504c1fcd45dd182f9d43e5de7232086898 WatchSource:0}: Error finding container db8a1fb0cfecbac5be30fad56d50a5504c1fcd45dd182f9d43e5de7232086898: Status 404 returned error can't find the container with id db8a1fb0cfecbac5be30fad56d50a5504c1fcd45dd182f9d43e5de7232086898 Jul 08 19:38:48.470218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.470190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:48.470218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.470225 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:48.470438 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:48.470297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:48.470438 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:48.470315 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:38:48.470438 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:48.470366 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:49.470351633 +0000 UTC m=+246.458155483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : secret "router-metrics-certs-default" not found Jul 08 19:38:48.470438 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:48.470398 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:48.470438 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:48.470435 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:49.470419209 +0000 UTC m=+246.458223058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:38:48.470609 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:48.470453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:49.47044725 +0000 UTC m=+246.458251098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:49.219035 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:49.218996 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" event={"ID":"62b6fe70-e8ef-48ab-bc49-4d41db755481","Type":"ContainerStarted","Data":"db8a1fb0cfecbac5be30fad56d50a5504c1fcd45dd182f9d43e5de7232086898"} Jul 08 19:38:49.220544 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:49.220517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" event={"ID":"198a965e-f984-442f-9c85-89ab02f4489e","Type":"ContainerStarted","Data":"b15c1b84905ae8f36cd211b5be86f46aeabf498b74fdc8f982e16d6c3f2f22fb"} Jul 08 19:38:49.481064 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:49.480980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:49.481258 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:49.481064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:49.481324 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:49.481265 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:51.481243552 +0000 UTC m=+248.469047418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:38:49.481324 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:49.481297 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:38:49.481435 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:49.481357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:49.481435 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:49.481427 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:51.481411874 +0000 UTC m=+248.469215740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : secret "router-metrics-certs-default" not found Jul 08 19:38:49.481542 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:49.481437 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:49.481542 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:49.481513 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:51.481471147 +0000 UTC m=+248.469275015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:51.226375 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.226337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" event={"ID":"62b6fe70-e8ef-48ab-bc49-4d41db755481","Type":"ContainerStarted","Data":"9db2407f564092566bae2e7860b406024cdea6ce80dc4bd086bbe32c4b229d30"} Jul 08 19:38:51.227736 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.227710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" event={"ID":"198a965e-f984-442f-9c85-89ab02f4489e","Type":"ContainerStarted","Data":"7f5209f0504d6074bb15f1819319ccc9f499e1cdf9677e50767863e71d9e867c"} Jul 08 19:38:51.243016 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.242964 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ltj7" podStartSLOduration=2.383842525 podStartE2EDuration="4.24294982s" totalImagesPullingTime="1.859107295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:51.242206565 +0000 UTC m=+248.230010428" watchObservedRunningTime="2026-07-08 19:38:51.24294982 +0000 UTC m=+248.230753691" Jul 08 19:38:51.259745 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.259697 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" podStartSLOduration=2.307094244 podStartE2EDuration="4.259681776s" totalImagesPullingTime="1.952587532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:51.258771283 +0000 UTC m=+248.246575151" watchObservedRunningTime="2026-07-08 19:38:51.259681776 +0000 UTC m=+248.247485647" Jul 08 19:38:51.321931 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.321899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:51.422438 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.422409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:51.499866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.499790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:51.500014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.499888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:51.500014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.499921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:51.500014 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:51.499934 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:51.500014 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:51.500002 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.49998402 +0000 UTC m=+252.487787871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:51.500014 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:51.500008 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:38:51.500301 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:51.500040 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.50002535 +0000 UTC m=+252.487829203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:38:51.500301 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:51.500068 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.500058499 +0000 UTC m=+252.487862348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : secret "router-metrics-certs-default" not found Jul 08 19:38:51.882211 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.882161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:51.968577 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:51.968544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.007046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.007020 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7zrrh"] Jul 08 19:38:52.009411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.009391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.016058 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.015802 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:38:52.017136 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.017110 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:38:52.017526 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.017496 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7sx7p\"" Jul 08 19:38:52.017599 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.017528 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:38:52.017799 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.017782 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:38:52.030045 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.030017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7zrrh"] Jul 08 19:38:52.065474 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.065423 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.104924 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.104897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865477e2-e834-40c2-9ca0-a85032a7b333-data-volume\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.105025 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.104951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865477e2-e834-40c2-9ca0-a85032a7b333-crio-socket\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.105025 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.104970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.105025 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.105008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.105129 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.105051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjls5\" (UniqueName: \"kubernetes.io/projected/865477e2-e834-40c2-9ca0-a85032a7b333-kube-api-access-pjls5\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206324 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865477e2-e834-40c2-9ca0-a85032a7b333-crio-socket\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206324 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206324 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.206363 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865477e2-e834-40c2-9ca0-a85032a7b333-crio-socket\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.206417 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.206425 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:52.706405789 +0000 UTC m=+249.694209641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : configmap "kube-rbac-proxy" not found Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjls5\" (UniqueName: \"kubernetes.io/projected/865477e2-e834-40c2-9ca0-a85032a7b333-kube-api-access-pjls5\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.206554 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:52.706538826 +0000 UTC m=+249.694342689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.206638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865477e2-e834-40c2-9ca0-a85032a7b333-data-volume\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.206935 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.206917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865477e2-e834-40c2-9ca0-a85032a7b333-data-volume\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.216267 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.216238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjls5\" (UniqueName: \"kubernetes.io/projected/865477e2-e834-40c2-9ca0-a85032a7b333-kube-api-access-pjls5\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.322830 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.322800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.380039 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.380012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.595843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.595807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.697280 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.697245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.711538 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.711502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.711538 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.711544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:52.711697 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.711621 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:52.711697 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.711654 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.711697 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.711669 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:53.711657514 +0000 UTC m=+250.699461363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : configmap "kube-rbac-proxy" not found Jul 08 19:38:52.711811 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:52.711719 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:53.711703527 +0000 UTC m=+250.699507378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.870819 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.870746 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:52.898357 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.898329 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69"] Jul 08 19:38:52.900362 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.900345 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" Jul 08 19:38:52.903000 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.902981 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 19:38:52.904282 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.904263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:52.904391 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.904374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7qc6t\"" Jul 08 19:38:52.912037 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.912014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69"] Jul 08 19:38:52.965993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:52.965946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:53.014125 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.014099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5rgq\" (UniqueName: \"kubernetes.io/projected/c8f6e680-647d-4cb4-9683-f92f272e4358-kube-api-access-x5rgq\") pod \"migrator-d57d58cc9-6hm69\" (UID: \"c8f6e680-647d-4cb4-9683-f92f272e4358\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" Jul 08 19:38:53.066242 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.066220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:53.115476 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.115440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5rgq\" (UniqueName: \"kubernetes.io/projected/c8f6e680-647d-4cb4-9683-f92f272e4358-kube-api-access-x5rgq\") pod \"migrator-d57d58cc9-6hm69\" (UID: \"c8f6e680-647d-4cb4-9683-f92f272e4358\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" Jul 08 19:38:53.123734 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.123671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5rgq\" (UniqueName: \"kubernetes.io/projected/c8f6e680-647d-4cb4-9683-f92f272e4358-kube-api-access-x5rgq\") pod \"migrator-d57d58cc9-6hm69\" (UID: \"c8f6e680-647d-4cb4-9683-f92f272e4358\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" Jul 08 19:38:53.208781 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.208744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" Jul 08 19:38:53.336753 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.336710 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69"] Jul 08 19:38:53.339083 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:38:53.339051 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f6e680_647d_4cb4_9683_f92f272e4358.slice/crio-0d64651d2807da86c90585ee2220cb046ee4ee7bcc89683563d272d8d64fa285 WatchSource:0}: Error finding container 0d64651d2807da86c90585ee2220cb046ee4ee7bcc89683563d272d8d64fa285: Status 404 returned error can't find the container with id 0d64651d2807da86c90585ee2220cb046ee4ee7bcc89683563d272d8d64fa285 Jul 08 19:38:53.720646 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.720607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:53.720646 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.720660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:53.720887 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:53.720801 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:53.720887 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:53.720804 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:53.720887 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:53.720870 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.720852342 +0000 UTC m=+252.708656194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : configmap "kube-rbac-proxy" not found Jul 08 19:38:53.720887 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:53.720888 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.720879207 +0000 UTC m=+252.708683057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:53.944697 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:53.944675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pn57x_44a97c13-4c66-40f6-b7fc-0898c34e0e6d/dns-node-resolver/0.log" Jul 08 19:38:54.227774 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:54.227741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:54.235245 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:54.235210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" event={"ID":"c8f6e680-647d-4cb4-9683-f92f272e4358","Type":"ContainerStarted","Data":"0d64651d2807da86c90585ee2220cb046ee4ee7bcc89683563d272d8d64fa285"} Jul 08 19:38:54.287702 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:54.287670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:54.749283 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:54.749251 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-57sf7_4939a718-e97c-4533-8ff3-90eb5cc09726/node-ca/0.log" Jul 08 19:38:55.164296 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.164265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:55.240211 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.240161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" event={"ID":"c8f6e680-647d-4cb4-9683-f92f272e4358","Type":"ContainerStarted","Data":"db7b7c31ee90ebce7f8cfec24d15024cc52218711de70dcc9cbb56f8e2e9e334"} Jul 08 19:38:55.240380 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.240228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" event={"ID":"c8f6e680-647d-4cb4-9683-f92f272e4358","Type":"ContainerStarted","Data":"a65b21a729317cbf74e3ec8d24f35589e34b88ae321708cbca13511cbadfd3b3"} Jul 08 19:38:55.261720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.261666 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-6hm69" podStartSLOduration=1.5230491069999998 podStartE2EDuration="3.261650433s" totalImagesPullingTime="1.738601326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:55.260135478 +0000 UTC m=+252.247939362" watchObservedRunningTime="2026-07-08 19:38:55.261650433 +0000 UTC m=+252.249454304" Jul 08 19:38:55.334688 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.334610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:38:55.334833 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.334743 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:38:55.334833 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.334807 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs podName:fc37c758-7eff-42f2-9c79-6383b3c01abf nodeName:}" failed. No retries permitted until 2026-07-08 19:40:57.334790449 +0000 UTC m=+374.322594298 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs") pod "network-metrics-daemon-2b7nn" (UID: "fc37c758-7eff-42f2-9c79-6383b3c01abf") : secret "metrics-daemon-secret" not found Jul 08 19:38:55.535765 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.535734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:55.535765 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.535772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:38:55.535980 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.535824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:38:55.535980 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.535916 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:03.535895589 +0000 UTC m=+260.523699445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:38:55.535980 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.535959 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:55.535980 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.535963 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:38:55.536123 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.536014 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:03.536003008 +0000 UTC m=+260.523806865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:38:55.536123 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.536031 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:03.536021811 +0000 UTC m=+260.523825664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : secret "router-metrics-certs-default" not found Jul 08 19:38:55.546099 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.546081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gld2j_4a040575-7104-450c-b6f8-2505a0bd3cd1/serve-healthcheck-canary/0.log" Jul 08 19:38:55.738024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.737934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:55.738024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:55.737973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:55.738271 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.738086 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:55.738271 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.738103 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:55.738271 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.738165 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:59.738146654 +0000 UTC m=+256.725950503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : configmap "kube-rbac-proxy" not found Jul 08 19:38:55.738271 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:55.738208 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:59.738198662 +0000 UTC m=+256.726002511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:58.120213 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.120111 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.383189 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.383099 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.479991 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.479956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.600224 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.600193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.702563 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.702482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.815729 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.815704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:58.916726 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:58.916701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:59.167959 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:59.167929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:59.769291 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:59.769249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:59.769291 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:59.769288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:38:59.769514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:59.769399 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:59.769514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:59.769411 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:59.769514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:59.769464 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:07.769447139 +0000 UTC m=+264.757250988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : configmap "kube-rbac-proxy" not found Jul 08 19:38:59.769514 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:38:59.769490 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:07.769472009 +0000 UTC m=+264.757275858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:59.835124 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:38:59.835074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:00.034422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:00.034338 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:00.430502 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:00.430422 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:00.641371 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:00.641335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:01.020489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:01.020449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:01.686794 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:01.686763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:01.820384 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:01.820352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:02.011515 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:02.011485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:02.082827 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:02.082803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:02.416218 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:02.416128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:02.620717 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:02.620688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:02.996335 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:02.996306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:03.052268 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.052242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:03.599356 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.599318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:03.599356 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.599358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:03.599599 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.599413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:39:03.599599 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:03.599508 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle podName:ffb6e633-7590-4ffa-8891-b53297bcc0a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:19.599486731 +0000 UTC m=+276.587290584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle") pod "router-default-bcdc55579-xpxfj" (UID: "ffb6e633-7590-4ffa-8891-b53297bcc0a6") : configmap references non-existent config key: service-ca.crt Jul 08 19:39:03.599599 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:03.599545 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:39:03.599599 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:03.599589 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls podName:fdad0506-1bc8-4076-9519-546cc4283fe7 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:19.599577956 +0000 UTC m=+276.587381811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c8s4q" (UID: "fdad0506-1bc8-4076-9519-546cc4283fe7") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:39:03.601963 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.601936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffb6e633-7590-4ffa-8891-b53297bcc0a6-metrics-certs\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:03.820391 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:03.820322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:04.216862 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:04.216829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:04.421563 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:04.421532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:04.613556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:04.613528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:04.754357 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:04.754324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:04.856082 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:04.856051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:05.224837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:05.224803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:05.814673 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:05.814640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:06.023506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:06.023474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:06.217404 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:06.217325 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:06.416489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:06.416456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:06.617822 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:06.617785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:07.217675 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:07.217627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:07.812108 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:07.812073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:07.835134 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:07.835105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:07.835273 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:07.835136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:07.835309 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:07.835273 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:39:07.835341 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:07.835336 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls podName:865477e2-e834-40c2-9ca0-a85032a7b333 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:23.835321047 +0000 UTC m=+280.823124896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7zrrh" (UID: "865477e2-e834-40c2-9ca0-a85032a7b333") : secret "insights-runtime-extractor-tls" not found Jul 08 19:39:07.835639 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:07.835622 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865477e2-e834-40c2-9ca0-a85032a7b333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:08.014192 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:08.014158 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:08.420934 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:08.420899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:08.644396 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:08.644366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:08.824464 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:08.824427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:14.399957 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:14.399922 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:14.498086 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:14.498057 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:15.108478 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.108449 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64bfbbd747-vjdkl"] Jul 08 19:39:15.111012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.110996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.115609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.115283 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tq925\"" Jul 08 19:39:15.115609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.115433 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 19:39:15.115609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.115588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 19:39:15.116310 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.115948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:15.116310 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.116125 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 19:39:15.120046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.120025 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 19:39:15.125656 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.125635 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bfbbd747-vjdkl"] Jul 08 19:39:15.188161 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.188107 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:15.193554 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-trusted-ca\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193658 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-image-registry-private-configuration\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193658 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911632c7-76ff-4ec3-853a-9454bc865953-ca-trust-extracted\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193736 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-registry-certificates\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193736 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-bound-sa-token\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-installation-pull-secrets\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8r8m\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-kube-api-access-q8r8m\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.193826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.193798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-registry-tls\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294362 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-installation-pull-secrets\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294362 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8r8m\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-kube-api-access-q8r8m\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294576 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-registry-tls\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294651 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-trusted-ca\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294782 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-image-registry-private-configuration\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294782 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911632c7-76ff-4ec3-853a-9454bc865953-ca-trust-extracted\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294782 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-registry-certificates\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.294782 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.294763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-bound-sa-token\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.295241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.295164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/911632c7-76ff-4ec3-853a-9454bc865953-ca-trust-extracted\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.295559 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.295534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-trusted-ca\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.295669 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.295648 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/911632c7-76ff-4ec3-853a-9454bc865953-registry-certificates\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.297459 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.297429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-image-registry-private-configuration\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.297638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.297622 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-registry-tls\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.297678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.297651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/911632c7-76ff-4ec3-853a-9454bc865953-installation-pull-secrets\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.302961 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.302939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8r8m\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-kube-api-access-q8r8m\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.303159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.303139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/911632c7-76ff-4ec3-853a-9454bc865953-bound-sa-token\") pod \"image-registry-64bfbbd747-vjdkl\" (UID: \"911632c7-76ff-4ec3-853a-9454bc865953\") " pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.421718 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.421651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:15.545764 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:15.545744 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bfbbd747-vjdkl"] Jul 08 19:39:15.547864 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:15.547841 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911632c7_76ff_4ec3_853a_9454bc865953.slice/crio-9145e7570d4b959b0c70ec7b1dabe0551f1da23e87d6fda7c7614a328d3c9867 WatchSource:0}: Error finding container 9145e7570d4b959b0c70ec7b1dabe0551f1da23e87d6fda7c7614a328d3c9867: Status 404 returned error can't find the container with id 9145e7570d4b959b0c70ec7b1dabe0551f1da23e87d6fda7c7614a328d3c9867 Jul 08 19:39:16.218826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.218787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:16.274307 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.274277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:16.302911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.302881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" event={"ID":"911632c7-76ff-4ec3-853a-9454bc865953","Type":"ContainerStarted","Data":"488aa6513f823621cac26785e006115c96b10431fb41142aae8d8eb75f6bd261"} Jul 08 19:39:16.303034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.302933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" event={"ID":"911632c7-76ff-4ec3-853a-9454bc865953","Type":"ContainerStarted","Data":"9145e7570d4b959b0c70ec7b1dabe0551f1da23e87d6fda7c7614a328d3c9867"} Jul 08 19:39:16.303102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.303035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:16.323636 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:16.323584 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" podStartSLOduration=1.323567822 podStartE2EDuration="1.323567822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:16.322323819 +0000 UTC m=+273.310127692" watchObservedRunningTime="2026-07-08 19:39:16.323567822 +0000 UTC m=+273.311371693" Jul 08 19:39:19.628943 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.628911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:39:19.629436 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.628967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:19.629560 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.629536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb6e633-7590-4ffa-8891-b53297bcc0a6-service-ca-bundle\") pod \"router-default-bcdc55579-xpxfj\" (UID: \"ffb6e633-7590-4ffa-8891-b53297bcc0a6\") " pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:19.631489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.631467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdad0506-1bc8-4076-9519-546cc4283fe7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c8s4q\" (UID: \"fdad0506-1bc8-4076-9519-546cc4283fe7\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:39:19.918143 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.918048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" Jul 08 19:39:19.928249 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:19.928213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:20.050487 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.050459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q"] Jul 08 19:39:20.053299 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:20.053275 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdad0506_1bc8_4076_9519_546cc4283fe7.slice/crio-d8caeb84c423cf11c5e103d22ca04f0957df38b69de80c6417751048733eaa87 WatchSource:0}: Error finding container d8caeb84c423cf11c5e103d22ca04f0957df38b69de80c6417751048733eaa87: Status 404 returned error can't find the container with id d8caeb84c423cf11c5e103d22ca04f0957df38b69de80c6417751048733eaa87 Jul 08 19:39:20.068863 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.068841 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bcdc55579-xpxfj"] Jul 08 19:39:20.071376 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:20.071352 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb6e633_7590_4ffa_8891_b53297bcc0a6.slice/crio-d16c2e1eb172152585980a2cdd429fb3f79f29dce6e968530ac8b499dc3c11b1 WatchSource:0}: Error finding container d16c2e1eb172152585980a2cdd429fb3f79f29dce6e968530ac8b499dc3c11b1: Status 404 returned error can't find the container with id d16c2e1eb172152585980a2cdd429fb3f79f29dce6e968530ac8b499dc3c11b1 Jul 08 19:39:20.317601 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.317564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bcdc55579-xpxfj" event={"ID":"ffb6e633-7590-4ffa-8891-b53297bcc0a6","Type":"ContainerStarted","Data":"7b15452433b1ab267a4e119efcf6b34d6cd67e2434e8b8666b7ca5523c5266ab"} Jul 08 19:39:20.317795 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.317621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bcdc55579-xpxfj" event={"ID":"ffb6e633-7590-4ffa-8891-b53297bcc0a6","Type":"ContainerStarted","Data":"d16c2e1eb172152585980a2cdd429fb3f79f29dce6e968530ac8b499dc3c11b1"} Jul 08 19:39:20.318680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.318656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" event={"ID":"fdad0506-1bc8-4076-9519-546cc4283fe7","Type":"ContainerStarted","Data":"d8caeb84c423cf11c5e103d22ca04f0957df38b69de80c6417751048733eaa87"} Jul 08 19:39:20.337299 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.337252 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bcdc55579-xpxfj" podStartSLOduration=33.337237165 podStartE2EDuration="33.337237165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:20.336453781 +0000 UTC m=+277.324257668" watchObservedRunningTime="2026-07-08 19:39:20.337237165 +0000 UTC m=+277.325041036" Jul 08 19:39:20.928411 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.928365 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:20.931141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:20.931115 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:21.322407 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:21.322376 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:21.323746 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:21.323722 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bcdc55579-xpxfj" Jul 08 19:39:22.326438 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:22.326401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" event={"ID":"fdad0506-1bc8-4076-9519-546cc4283fe7","Type":"ContainerStarted","Data":"54a6d993705b9dd3906b66b1ef09c4e30e119cf85f15d56f4fe46c49fb6856a2"} Jul 08 19:39:22.565876 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:22.565839 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:22.665088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:22.665057 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:22.739437 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:22.739406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:22.871622 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:22.871548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:23.864609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:23.864557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:23.866983 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:23.866955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865477e2-e834-40c2-9ca0-a85032a7b333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7zrrh\" (UID: \"865477e2-e834-40c2-9ca0-a85032a7b333\") " pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:24.121530 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:24.121426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7zrrh" Jul 08 19:39:24.249704 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:24.249595 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c8s4q" podStartSLOduration=35.052013541 podStartE2EDuration="37.249572582s" totalImagesPullingTime="2.197559041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:22.343224549 +0000 UTC m=+279.331028419" watchObservedRunningTime="2026-07-08 19:39:24.249572582 +0000 UTC m=+281.237376452" Jul 08 19:39:24.250398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:24.250376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7zrrh"] Jul 08 19:39:24.253220 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:24.253198 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865477e2_e834_40c2_9ca0_a85032a7b333.slice/crio-f9d4308d5a7aa79ed07d7e38c95521e74784bfb05bc2516465a8ed1f2ec85dcd WatchSource:0}: Error finding container f9d4308d5a7aa79ed07d7e38c95521e74784bfb05bc2516465a8ed1f2ec85dcd: Status 404 returned error can't find the container with id f9d4308d5a7aa79ed07d7e38c95521e74784bfb05bc2516465a8ed1f2ec85dcd Jul 08 19:39:24.333867 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:24.333833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7zrrh" event={"ID":"865477e2-e834-40c2-9ca0-a85032a7b333","Type":"ContainerStarted","Data":"f9d4308d5a7aa79ed07d7e38c95521e74784bfb05bc2516465a8ed1f2ec85dcd"} Jul 08 19:39:25.012385 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:25.012336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-82fkw" podUID="6cba8a16-6b11-4417-8476-92eb6b69903b" Jul 08 19:39:25.338563 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:25.338479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:25.760294 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:25.760258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:25.830970 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:25.830931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:26.282024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:26.281985 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:28.350216 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.350158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7zrrh" event={"ID":"865477e2-e834-40c2-9ca0-a85032a7b333","Type":"ContainerStarted","Data":"42619809123dfbfaf482fb8f47d905f46841a1a0f8120b54fd2197e82115cda9"} Jul 08 19:39:28.398655 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.398614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:28.400983 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.400965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cba8a16-6b11-4417-8476-92eb6b69903b-metrics-tls\") pod \"dns-default-82fkw\" (UID: \"6cba8a16-6b11-4417-8476-92eb6b69903b\") " pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:28.642316 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.642230 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6zdff\"" Jul 08 19:39:28.650598 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.650573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:28.797422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:28.797387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82fkw"] Jul 08 19:39:28.806761 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:28.806722 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cba8a16_6b11_4417_8476_92eb6b69903b.slice/crio-8b4a43d37a154953c3d8573df024b4d3e848173e7672af2e4d6e8ee9028fb906 WatchSource:0}: Error finding container 8b4a43d37a154953c3d8573df024b4d3e848173e7672af2e4d6e8ee9028fb906: Status 404 returned error can't find the container with id 8b4a43d37a154953c3d8573df024b4d3e848173e7672af2e4d6e8ee9028fb906 Jul 08 19:39:29.320902 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:29.320862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:29.356565 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:29.356477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7zrrh" event={"ID":"865477e2-e834-40c2-9ca0-a85032a7b333","Type":"ContainerStarted","Data":"515f7185b003925098ab64157125b62f6f5a3ead055658a1bfd70b7195dd42d8"} Jul 08 19:39:29.358638 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:29.358568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82fkw" event={"ID":"6cba8a16-6b11-4417-8476-92eb6b69903b","Type":"ContainerStarted","Data":"8b4a43d37a154953c3d8573df024b4d3e848173e7672af2e4d6e8ee9028fb906"} Jul 08 19:39:30.995032 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:30.994996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:31.887001 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:31.886974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.000419 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.000387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.115434 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.115400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.137658 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.137563 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq"] Jul 08 19:39:32.139989 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.139968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.143123 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.143099 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kt5gd\"" Jul 08 19:39:32.143321 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.143232 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 19:39:32.143547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.143529 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:39:32.144365 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.144349 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:39:32.154751 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.154730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq"] Jul 08 19:39:32.155521 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.155505 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f94kf"] Jul 08 19:39:32.157547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.157530 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.160284 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.160260 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:39:32.160431 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.160269 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:39:32.160589 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.160568 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4lrr\"" Jul 08 19:39:32.160675 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.160647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:39:32.217700 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.217659 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.229818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92250f1f-2211-4b1d-9e69-529e8e9f862f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.229818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-accelerators-collector-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzhf\" (UniqueName: \"kubernetes.io/projected/92250f1f-2211-4b1d-9e69-529e8e9f862f-kube-api-access-mkzhf\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-wtmp\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-metrics-client-ca\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229971 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.230034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.229991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-sys\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.230047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zsrk\" (UniqueName: \"kubernetes.io/projected/9a0f827b-53a2-43a4-8d4b-ed6b79359360-kube-api-access-8zsrk\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.230100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.230290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.230119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-root\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.230200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-textfile\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.230290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.230226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.317105 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.317066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.331170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-root\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331350 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-textfile\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331350 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331250 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-root\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331350 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331350 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92250f1f-2211-4b1d-9e69-529e8e9f862f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.331350 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-accelerators-collector-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:32.331362 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzhf\" (UniqueName: \"kubernetes.io/projected/92250f1f-2211-4b1d-9e69-529e8e9f862f-kube-api-access-mkzhf\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-wtmp\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:32.331427 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls podName:9a0f827b-53a2-43a4-8d4b-ed6b79359360 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:32.831405475 +0000 UTC m=+289.819209337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls") pod "node-exporter-f94kf" (UID: "9a0f827b-53a2-43a4-8d4b-ed6b79359360") : secret "node-exporter-tls" not found Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-metrics-client-ca\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-wtmp\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-sys\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.331596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zsrk\" (UniqueName: \"kubernetes.io/projected/9a0f827b-53a2-43a4-8d4b-ed6b79359360-kube-api-access-8zsrk\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.332153 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.332153 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.331793 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a0f827b-53a2-43a4-8d4b-ed6b79359360-sys\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.332153 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.332041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-accelerators-collector-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.332153 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.332098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0f827b-53a2-43a4-8d4b-ed6b79359360-metrics-client-ca\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.332566 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.332170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-textfile\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.332566 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.332390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92250f1f-2211-4b1d-9e69-529e8e9f862f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.333857 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.333833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.334216 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.334167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.334300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.334169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/92250f1f-2211-4b1d-9e69-529e8e9f862f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.342557 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.342523 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zsrk\" (UniqueName: \"kubernetes.io/projected/9a0f827b-53a2-43a4-8d4b-ed6b79359360-kube-api-access-8zsrk\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.342715 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.342696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzhf\" (UniqueName: \"kubernetes.io/projected/92250f1f-2211-4b1d-9e69-529e8e9f862f-kube-api-access-mkzhf\") pod \"openshift-state-metrics-54cf96dfcf-q54bq\" (UID: \"92250f1f-2211-4b1d-9e69-529e8e9f862f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.371291 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.371249 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7zrrh" event={"ID":"865477e2-e834-40c2-9ca0-a85032a7b333","Type":"ContainerStarted","Data":"977756a56666ab77ef740f0c5c1bc356f414a9c9a33b7abf3037d532a1f09df6"} Jul 08 19:39:32.373074 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.373051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82fkw" event={"ID":"6cba8a16-6b11-4417-8476-92eb6b69903b","Type":"ContainerStarted","Data":"a59f7832064a0fbe026efdac7524ca1dd3b29ed65b5f12b8681760d66734f9b3"} Jul 08 19:39:32.373217 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.373095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82fkw" event={"ID":"6cba8a16-6b11-4417-8476-92eb6b69903b","Type":"ContainerStarted","Data":"26cf1681557be1921c26d194db1d976dab5a71d39f80797e2a0c54b8b8208183"} Jul 08 19:39:32.373217 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.373116 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:32.388889 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.388784 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7zrrh" podStartSLOduration=34.244909629 podStartE2EDuration="41.38876808s" totalImagesPullingTime="7.143858451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:38:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:32.388243202 +0000 UTC m=+289.376047073" watchObservedRunningTime="2026-07-08 19:39:32.38876808 +0000 UTC m=+289.376571951" Jul 08 19:39:32.404623 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.404573 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-82fkw" podStartSLOduration=251.709439553 podStartE2EDuration="4m14.404554582s" totalImagesPullingTime="2.695115029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:32.404273702 +0000 UTC m=+289.392077574" watchObservedRunningTime="2026-07-08 19:39:32.404554582 +0000 UTC m=+289.392358453" Jul 08 19:39:32.422118 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.422089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.448794 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.448766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" Jul 08 19:39:32.526679 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.526649 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.584168 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.584133 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq"] Jul 08 19:39:32.587894 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:32.587864 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92250f1f_2211_4b1d_9e69_529e8e9f862f.slice/crio-f89c2046e690c622190792318a6605ac974a4a1914f6c1d888207e2f464fa861 WatchSource:0}: Error finding container f89c2046e690c622190792318a6605ac974a4a1914f6c1d888207e2f464fa861: Status 404 returned error can't find the container with id f89c2046e690c622190792318a6605ac974a4a1914f6c1d888207e2f464fa861 Jul 08 19:39:32.612593 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.612563 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.681317 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.681289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.779319 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.779281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.836704 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.836664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.839105 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.839070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a0f827b-53a2-43a4-8d4b-ed6b79359360-node-exporter-tls\") pod \"node-exporter-f94kf\" (UID: \"9a0f827b-53a2-43a4-8d4b-ed6b79359360\") " pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:32.882331 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.882304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:32.979497 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:32.979403 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.066133 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.066097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f94kf" Jul 08 19:39:33.078194 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:33.078143 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0f827b_53a2_43a4_8d4b_ed6b79359360.slice/crio-70db5c57cc681964f3fb90a7832b28cc7f3670a90a209374acb06a19ff1a0516 WatchSource:0}: Error finding container 70db5c57cc681964f3fb90a7832b28cc7f3670a90a209374acb06a19ff1a0516: Status 404 returned error can't find the container with id 70db5c57cc681964f3fb90a7832b28cc7f3670a90a209374acb06a19ff1a0516 Jul 08 19:39:33.170323 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.170290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.236626 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.236525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.244282 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.244252 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:39:33.248591 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.248573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.251485 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.251462 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 19:39:33.251691 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.251668 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 19:39:33.251837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.251691 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 19:39:33.251837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.251734 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 19:39:33.251837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.251734 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g8lw2\"" Jul 08 19:39:33.252091 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.252076 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 19:39:33.252091 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.252089 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 19:39:33.252169 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.252128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 19:39:33.252241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.252227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 19:39:33.252312 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.252295 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 19:39:33.262500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.262478 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:39:33.339866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.339835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.339883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.339903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.339963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.339995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340020 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.340233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.340199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2k9\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.380200 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.380142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" event={"ID":"92250f1f-2211-4b1d-9e69-529e8e9f862f","Type":"ContainerStarted","Data":"cd075c77e2391d5ba5f26429bff641fc4110aa380e81299ee881c67197888989"} Jul 08 19:39:33.380352 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.380229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" event={"ID":"92250f1f-2211-4b1d-9e69-529e8e9f862f","Type":"ContainerStarted","Data":"5ec24869650f9d43491adbc2ae430ac3698bd35e26f83e8f00dda3327ea12f47"} Jul 08 19:39:33.380352 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.380258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" event={"ID":"92250f1f-2211-4b1d-9e69-529e8e9f862f","Type":"ContainerStarted","Data":"f89c2046e690c622190792318a6605ac974a4a1914f6c1d888207e2f464fa861"} Jul 08 19:39:33.381660 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.381628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f94kf" event={"ID":"9a0f827b-53a2-43a4-8d4b-ed6b79359360","Type":"ContainerStarted","Data":"70db5c57cc681964f3fb90a7832b28cc7f3670a90a209374acb06a19ff1a0516"} Jul 08 19:39:33.386241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.386216 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.441584 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.441584 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.441897 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.441897 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2k9\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.441897 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.441961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442046 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442245 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442245 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442245 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442245 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:33.442158 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle podName:7c84cabe-ffe9-447d-a152-d42ae1dbe3d5 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:33.942137304 +0000 UTC m=+290.929941158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5") : configmap references non-existent config key: ca-bundle.crt Jul 08 19:39:33.442245 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442511 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.442597 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.442577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.443524 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:33.442880 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 08 19:39:33.443524 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:33.442932 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls podName:7c84cabe-ffe9-447d-a152-d42ae1dbe3d5 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:33.942917203 +0000 UTC m=+290.930721059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5") : secret "alertmanager-main-tls" not found Jul 08 19:39:33.445001 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.444347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.445565 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.445540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.445849 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.445823 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.446058 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.446033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.446443 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.446416 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.446872 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.446816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.447224 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.447203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.447888 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.447870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.447989 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.447904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.451019 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.450998 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2k9\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.587336 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.587299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.699816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.699772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.796155 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.796116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:33.946519 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.946489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.946680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.946597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:33.946842 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:33.946684 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 08 19:39:33.946842 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:33.946756 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls podName:7c84cabe-ffe9-447d-a152-d42ae1dbe3d5 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:34.946735144 +0000 UTC m=+291.934539011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5") : secret "alertmanager-main-tls" not found Jul 08 19:39:33.947632 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:33.947587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:34.174883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.174798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:34.348156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.348126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:34.386818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.386777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f94kf" event={"ID":"9a0f827b-53a2-43a4-8d4b-ed6b79359360","Type":"ContainerStarted","Data":"bbd3147f2eedb566ab87baf53809b47b758df4e928f888491903667c661ea521"} Jul 08 19:39:34.388925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.388899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" event={"ID":"92250f1f-2211-4b1d-9e69-529e8e9f862f","Type":"ContainerStarted","Data":"afc5b7947f7af845a486d0123f5e98daa79c464440d0d68a040a335ac5c26382"} Jul 08 19:39:34.428541 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.428453 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q54bq" podStartSLOduration=1.252724033 podStartE2EDuration="2.428436488s" totalImagesPullingTime="1.175712455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:34.427528095 +0000 UTC m=+291.415331965" watchObservedRunningTime="2026-07-08 19:39:34.428436488 +0000 UTC m=+291.416240358" Jul 08 19:39:34.630530 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.630490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:34.698441 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.698369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:34.954628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.954538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:34.956989 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:34.956956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:35.058303 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.058266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:39:35.081764 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.081735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:35.141060 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.141035 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8654ff7678-b7t42"] Jul 08 19:39:35.144100 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.144082 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.147881 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.147686 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 19:39:35.147881 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.147775 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 19:39:35.148032 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.148002 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 19:39:35.148080 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.148040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-85i7jerfjucbo\"" Jul 08 19:39:35.148135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.148111 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 19:39:35.148203 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.148160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hbqmw\"" Jul 08 19:39:35.148253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.148168 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 19:39:35.159952 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.159931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8654ff7678-b7t42"] Jul 08 19:39:35.162417 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.162390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:35.197412 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.197295 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:39:35.201706 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:35.201680 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c84cabe_ffe9_447d_a152_d42ae1dbe3d5.slice/crio-b6b7874cfdce4e9696a333fc2d02b4994465c593ba54d69d31062f0af84b432d WatchSource:0}: Error finding container b6b7874cfdce4e9696a333fc2d02b4994465c593ba54d69d31062f0af84b432d: Status 404 returned error can't find the container with id b6b7874cfdce4e9696a333fc2d02b4994465c593ba54d69d31062f0af84b432d Jul 08 19:39:35.256906 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.256882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-metrics-client-ca\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257031 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.256920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257031 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.256953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257031 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.257017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257230 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.257044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257230 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.257117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257230 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.257170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2fj\" (UniqueName: \"kubernetes.io/projected/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-kube-api-access-px2fj\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.257343 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.257253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-grpc-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.332563 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.332528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:35.357761 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2fj\" (UniqueName: \"kubernetes.io/projected/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-kube-api-access-px2fj\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-grpc-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-metrics-client-ca\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.357929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.358219 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.357950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.358697 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.358669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-metrics-client-ca\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.360918 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.360889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.361011 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.360923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.361072 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.361049 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.361229 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.361207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-grpc-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.361274 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.361228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-tls\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.361419 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.361400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.365238 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.365217 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2fj\" (UniqueName: \"kubernetes.io/projected/a7d5e134-66f2-436d-93c7-ecf2bd1ea11a-kube-api-access-px2fj\") pod \"thanos-querier-8654ff7678-b7t42\" (UID: \"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a\") " pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.393440 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.393401 2559 generic.go:356] "Generic (PLEG): container finished" podID="9a0f827b-53a2-43a4-8d4b-ed6b79359360" containerID="bbd3147f2eedb566ab87baf53809b47b758df4e928f888491903667c661ea521" exitCode=0 Jul 08 19:39:35.393550 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.393448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f94kf" event={"ID":"9a0f827b-53a2-43a4-8d4b-ed6b79359360","Type":"ContainerDied","Data":"bbd3147f2eedb566ab87baf53809b47b758df4e928f888491903667c661ea521"} Jul 08 19:39:35.394744 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.394722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"b6b7874cfdce4e9696a333fc2d02b4994465c593ba54d69d31062f0af84b432d"} Jul 08 19:39:35.421279 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.421247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:35.425907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.425830 2559 patch_prober.go:28] interesting pod/image-registry-64bfbbd747-vjdkl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:39:35.425907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.425878 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" podUID="911632c7-76ff-4ec3-853a-9454bc865953" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:39:35.454080 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.454058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:35.597422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:35.597397 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8654ff7678-b7t42"] Jul 08 19:39:35.599811 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:35.599784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d5e134_66f2_436d_93c7_ecf2bd1ea11a.slice/crio-4952a49d520b5787bf24b0d21a6dcb403cca127784a2a95f0d5b7f74a017f62a WatchSource:0}: Error finding container 4952a49d520b5787bf24b0d21a6dcb403cca127784a2a95f0d5b7f74a017f62a: Status 404 returned error can't find the container with id 4952a49d520b5787bf24b0d21a6dcb403cca127784a2a95f0d5b7f74a017f62a Jul 08 19:39:36.341675 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.341613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:36.401803 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.401758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f94kf" event={"ID":"9a0f827b-53a2-43a4-8d4b-ed6b79359360","Type":"ContainerStarted","Data":"da2b7a663663326f9e1010d3747aa0bf3f80d85877e20cf36cf73e73efef0433"} Jul 08 19:39:36.401971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.401831 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f94kf" event={"ID":"9a0f827b-53a2-43a4-8d4b-ed6b79359360","Type":"ContainerStarted","Data":"469b90bc7fbb79cf8e71a9558142afb893d8c322c07bcade7a5b00de2ac459a2"} Jul 08 19:39:36.403201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.403151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"4952a49d520b5787bf24b0d21a6dcb403cca127784a2a95f0d5b7f74a017f62a"} Jul 08 19:39:36.423698 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.423645 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f94kf" podStartSLOduration=3.160385838 podStartE2EDuration="4.423622167s" totalImagesPullingTime="1.188609838s" totalInitContainerRuntime="74.626491ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:36.421482264 +0000 UTC m=+293.409286159" watchObservedRunningTime="2026-07-08 19:39:36.423622167 +0000 UTC m=+293.411426038" Jul 08 19:39:36.926393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.926359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:36.938669 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.938312 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd"] Jul 08 19:39:36.940845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.940825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:36.943714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.943691 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 19:39:36.943826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.943699 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qn9kg\"" Jul 08 19:39:36.950695 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.950668 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd"] Jul 08 19:39:36.995880 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:36.995827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:37.074263 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.074222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.074419 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.074376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8qv\" (UniqueName: \"kubernetes.io/projected/9b22cbac-27ba-4d75-b853-19239da6c3a6-kube-api-access-nv8qv\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.175680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.175574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8qv\" (UniqueName: \"kubernetes.io/projected/9b22cbac-27ba-4d75-b853-19239da6c3a6-kube-api-access-nv8qv\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.175680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.175637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.175897 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:37.175769 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 08 19:39:37.175897 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:37.175852 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert podName:9b22cbac-27ba-4d75-b853-19239da6c3a6 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:37.675831176 +0000 UTC m=+294.663635032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-pmbhd" (UID: "9b22cbac-27ba-4d75-b853-19239da6c3a6") : secret "monitoring-plugin-cert" not found Jul 08 19:39:37.185628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.185583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8qv\" (UniqueName: \"kubernetes.io/projected/9b22cbac-27ba-4d75-b853-19239da6c3a6-kube-api-access-nv8qv\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.267065 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.267029 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:37.310476 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.310449 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64bfbbd747-vjdkl" Jul 08 19:39:37.407956 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.407925 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2" exitCode=0 Jul 08 19:39:37.408463 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.408012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2"} Jul 08 19:39:37.504450 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.504419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:37.543694 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:37.543651 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b7nn" podUID="fc37c758-7eff-42f2-9c79-6383b3c01abf" Jul 08 19:39:37.576946 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.576910 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:37.645808 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.645773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:37.680836 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.680797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.684189 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.684146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9b22cbac-27ba-4d75-b853-19239da6c3a6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pmbhd\" (UID: \"9b22cbac-27ba-4d75-b853-19239da6c3a6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.853388 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.853273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:37.938912 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:37.938876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:38.004613 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.004579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:38.375471 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.375438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:38.398493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.394448 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:39:38.400752 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.400727 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.429220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.429169 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 19:39:38.429587 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.429251 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 19:39:38.429587 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.429289 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2xp5m\"" Jul 08 19:39:38.429587 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.429566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 19:39:38.438415 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.438392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 19:39:38.438624 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.438426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 19:39:38.438850 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.438831 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3o4vedrrd6sns\"" Jul 08 19:39:38.456593 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 19:39:38.456674 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 19:39:38.456744 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456581 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 19:39:38.456804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456750 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 19:39:38.456804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456765 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 19:39:38.456804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456785 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 19:39:38.456952 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.456858 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 19:39:38.457294 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.457276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 19:39:38.457530 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.457508 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 19:39:38.488268 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488389 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488389 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488389 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488389 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zhkl\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.488821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.488818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.548958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.548930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 19:39:38.558100 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.558077 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd"] Jul 08 19:39:38.558628 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:38.558610 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b22cbac_27ba_4d75_b853_19239da6c3a6.slice/crio-2cbacf4fec6fdbd19e944fcfc60cde6c3b66c854d515dfccd655e815b7f415b7 WatchSource:0}: Error finding container 2cbacf4fec6fdbd19e944fcfc60cde6c3b66c854d515dfccd655e815b7f415b7: Status 404 returned error can't find the container with id 2cbacf4fec6fdbd19e944fcfc60cde6c3b66c854d515dfccd655e815b7f415b7 Jul 08 19:39:38.589992 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.589901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.589992 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.589942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.589992 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.589967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.589991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.590024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.590049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.590078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590281 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.590119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.590474 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.590396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zhkl\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.591958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.591693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.592752 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.592385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.592752 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.592382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.592752 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:39:38.592512 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle podName:b288f412-4515-49b9-8fa6-69cc355ab9d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:39.092492367 +0000 UTC m=+296.080296231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8") : configmap references non-existent config key: ca-bundle.crt Jul 08 19:39:38.593826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.593771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.593938 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.593809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.594467 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.594440 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.595468 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.595437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.596082 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.595860 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.596082 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.596058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.596270 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.596192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.596376 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.596357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.597019 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.596989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.597088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.597029 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.597258 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.597243 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.597778 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.597762 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.598239 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.598202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.621312 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.621286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zhkl\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:38.646422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:38.646389 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:39:39.096972 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.096938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:39.097677 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.097659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:39.323234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.323200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:39.331509 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.331475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:39.418634 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.418596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"5e0b7a03e6383f3b4d694a03a6c14f47842a0af9b3114e09353e3daec60babf1"} Jul 08 19:39:39.418811 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.418689 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"3170923c2064d3481db7b9edadb0738a0865083b56d5c7eddf9aa5d04803db78"} Jul 08 19:39:39.418811 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.418734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"d5d986f8d5d1024133b6a4afe2190385997e131ad6291ac8405e1ed5e22798c1"} Jul 08 19:39:39.421252 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.421218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" event={"ID":"9b22cbac-27ba-4d75-b853-19239da6c3a6","Type":"ContainerStarted","Data":"2cbacf4fec6fdbd19e944fcfc60cde6c3b66c854d515dfccd655e815b7f415b7"} Jul 08 19:39:39.433398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.433312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:39.503204 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:39.503153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:39:39.507872 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:39:39.507836 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb288f412_4515_49b9_8fa6_69cc355ab9d8.slice/crio-32e78b769b479110ff6356ea27ba27ce32cea7d9d07bb8bccd4189e4bab73a5c WatchSource:0}: Error finding container 32e78b769b479110ff6356ea27ba27ce32cea7d9d07bb8bccd4189e4bab73a5c: Status 404 returned error can't find the container with id 32e78b769b479110ff6356ea27ba27ce32cea7d9d07bb8bccd4189e4bab73a5c Jul 08 19:39:40.428304 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.428209 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"59636c5f3b411a9618bada960874e137ec8bc86ae0593cf090788e09d4522645"} Jul 08 19:39:40.429849 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.429820 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" exitCode=0 Jul 08 19:39:40.429985 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.429910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} Jul 08 19:39:40.429985 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.429970 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"32e78b769b479110ff6356ea27ba27ce32cea7d9d07bb8bccd4189e4bab73a5c"} Jul 08 19:39:40.431632 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.431607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" event={"ID":"9b22cbac-27ba-4d75-b853-19239da6c3a6","Type":"ContainerStarted","Data":"deafd17e6b912692b43e57277b83618bc998005ca7e4ba7a0a14285eaf8b884d"} Jul 08 19:39:40.431832 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.431818 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:40.438055 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.438036 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" Jul 08 19:39:40.480236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:40.480144 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pmbhd" podStartSLOduration=2.911492026 podStartE2EDuration="4.48012252s" totalImagesPullingTime="1.568630494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:40.478769565 +0000 UTC m=+297.466573451" watchObservedRunningTime="2026-07-08 19:39:40.48012252 +0000 UTC m=+297.467926394" Jul 08 19:39:41.394651 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.394591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:41.439200 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3"} Jul 08 19:39:41.439625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c"} Jul 08 19:39:41.439625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d"} Jul 08 19:39:41.439625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99"} Jul 08 19:39:41.439625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c"} Jul 08 19:39:41.439625 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.439414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerStarted","Data":"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac"} Jul 08 19:39:41.442123 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.442095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"b1a4649811fe2f6063894fdf696b85ac7d73c562ed5e6f53b9e5518bf692ae8d"} Jul 08 19:39:41.442274 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.442163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" event={"ID":"a7d5e134-66f2-436d-93c7-ecf2bd1ea11a","Type":"ContainerStarted","Data":"5eef54a46e43473230be1bfa3974a322df31344dbe3237e4f528ab8c480a4b37"} Jul 08 19:39:41.448340 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.448313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:41.475232 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.475187 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.649056499 podStartE2EDuration="8.475156301s" totalImagesPullingTime="4.803788933s" totalInitContainerRuntime="22.310869ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:41.472400421 +0000 UTC m=+298.460204321" watchObservedRunningTime="2026-07-08 19:39:41.475156301 +0000 UTC m=+298.462960172" Jul 08 19:39:41.507945 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:41.507859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" podStartSLOduration=2.192441481 podStartE2EDuration="6.507843945s" totalImagesPullingTime="4.315402464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:41.50765603 +0000 UTC m=+298.495459901" watchObservedRunningTime="2026-07-08 19:39:41.507843945 +0000 UTC m=+298.495647820" Jul 08 19:39:42.384837 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:42.384799 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-82fkw" Jul 08 19:39:42.447913 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:42.447876 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:43.459523 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:43.459495 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8654ff7678-b7t42" Jul 08 19:39:43.609869 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:43.609717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:43.697610 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:43.697582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:44.443834 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:44.443796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:44.481316 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:44.481285 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:39:44.544002 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:44.543801 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:45.464303 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} Jul 08 19:39:45.464482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464371 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} Jul 08 19:39:45.464482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464416 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} Jul 08 19:39:45.464482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464446 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} Jul 08 19:39:45.464482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} Jul 08 19:39:45.464633 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.464505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerStarted","Data":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} Jul 08 19:39:45.498650 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:45.498590 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.408416126 podStartE2EDuration="7.498573648s" totalImagesPullingTime="4.065807137s" totalInitContainerRuntime="24.350385ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:45.497377215 +0000 UTC m=+302.485181087" watchObservedRunningTime="2026-07-08 19:39:45.498573648 +0000 UTC m=+302.486377519" Jul 08 19:39:46.266196 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:46.266153 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:46.333686 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:46.333645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:46.740436 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:46.740345 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:46.869555 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:46.869526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:49.324304 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:49.324265 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:39:49.675549 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:49.675462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:49.776466 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:49.776430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:50.541997 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:50.541971 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:39:50.762354 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:50.762322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:50.873251 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:50.873146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:51.142950 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:51.142869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:51.298190 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:51.298143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:55.269960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:55.269925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:55.370651 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:55.370619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:57.783466 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:57.783441 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/init-config-reloader/0.log" Jul 08 19:39:57.980119 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:57.980093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/alertmanager/0.log" Jul 08 19:39:58.180628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.180558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/config-reloader/0.log" Jul 08 19:39:58.380042 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.380013 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/kube-rbac-proxy-web/0.log" Jul 08 19:39:58.580696 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.580645 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/kube-rbac-proxy/0.log" Jul 08 19:39:58.759287 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.759252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:58.780053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.780023 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/kube-rbac-proxy-metric/0.log" Jul 08 19:39:58.863611 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.863534 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:58.979357 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:58.979324 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/prom-label-proxy/0.log" Jul 08 19:39:59.181760 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:59.181683 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-c8s4q_fdad0506-1bc8-4076-9519-546cc4283fe7/cluster-monitoring-operator/0.log" Jul 08 19:39:59.405748 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:59.405712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:59.506715 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:39:59.506668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:00.179578 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.179553 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-pmbhd_9b22cbac-27ba-4d75-b853-19239da6c3a6/monitoring-plugin/0.log" Jul 08 19:40:00.382073 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.382044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/init-textfile/0.log" Jul 08 19:40:00.580265 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.580237 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/node-exporter/0.log" Jul 08 19:40:00.747866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.747831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:00.780096 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.780064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/kube-rbac-proxy/0.log" Jul 08 19:40:00.849380 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:00.849292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:02.180385 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:02.180359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/kube-rbac-proxy-main/0.log" Jul 08 19:40:02.380608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:02.380580 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/kube-rbac-proxy-self/0.log" Jul 08 19:40:02.579705 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:02.579674 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/openshift-state-metrics/0.log" Jul 08 19:40:02.780195 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:02.780144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/init-config-reloader/0.log" Jul 08 19:40:02.981921 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:02.981833 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/prometheus/0.log" Jul 08 19:40:03.180883 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:03.180856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/config-reloader/0.log" Jul 08 19:40:03.381200 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:03.381144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/thanos-sidecar/0.log" Jul 08 19:40:03.580907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:03.580881 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/kube-rbac-proxy-web/0.log" Jul 08 19:40:03.780622 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:03.780592 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/kube-rbac-proxy/0.log" Jul 08 19:40:03.984396 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:03.984368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b288f412-4515-49b9-8fa6-69cc355ab9d8/kube-rbac-proxy-thanos/0.log" Jul 08 19:40:05.381009 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:05.380969 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/thanos-query/0.log" Jul 08 19:40:05.579958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:05.579908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-web/0.log" Jul 08 19:40:05.780252 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:05.780224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy/0.log" Jul 08 19:40:05.982568 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:05.982544 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/prom-label-proxy/0.log" Jul 08 19:40:06.179555 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:06.179475 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-rules/0.log" Jul 08 19:40:06.379649 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:06.379615 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-metrics/0.log" Jul 08 19:40:11.566520 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:11.566429 2559 generic.go:356] "Generic (PLEG): container finished" podID="198a965e-f984-442f-9c85-89ab02f4489e" containerID="7f5209f0504d6074bb15f1819319ccc9f499e1cdf9677e50767863e71d9e867c" exitCode=0 Jul 08 19:40:11.566520 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:11.566476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" event={"ID":"198a965e-f984-442f-9c85-89ab02f4489e","Type":"ContainerDied","Data":"7f5209f0504d6074bb15f1819319ccc9f499e1cdf9677e50767863e71d9e867c"} Jul 08 19:40:11.567048 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:11.566868 2559 scope.go:117] "RemoveContainer" containerID="7f5209f0504d6074bb15f1819319ccc9f499e1cdf9677e50767863e71d9e867c" Jul 08 19:40:12.571747 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:12.571712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tqscw" event={"ID":"198a965e-f984-442f-9c85-89ab02f4489e","Type":"ContainerStarted","Data":"f958a9c86cbc9fca6bb8b4955f882c0013fa02b0d94c1ba2efd390ad183da9cf"} Jul 08 19:40:14.407121 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:14.407079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:14.504784 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:14.504749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:39.323896 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:39.323811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:39.340159 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:39.340136 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:39.692418 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:39.692352 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:42.517897 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:42.517860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:42.582263 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:42.582227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:48.232850 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:48.232786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:48.287468 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:48.287434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.492753 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:51.492719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.564786 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:51.564753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.624192 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:51.624129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:52.234131 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.234101 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:52.498578 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.498499 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:52.498935 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.498889 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="alertmanager" containerID="cri-o://172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac" gracePeriod=120 Jul 08 19:40:52.498997 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.498947 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-metric" containerID="cri-o://419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c" gracePeriod=120 Jul 08 19:40:52.499054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.498975 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-web" containerID="cri-o://c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99" gracePeriod=120 Jul 08 19:40:52.499054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.499000 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="prom-label-proxy" containerID="cri-o://ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3" gracePeriod=120 Jul 08 19:40:52.499170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.499020 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="config-reloader" containerID="cri-o://8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c" gracePeriod=120 Jul 08 19:40:52.499170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.499055 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy" containerID="cri-o://3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d" gracePeriod=120 Jul 08 19:40:52.732537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732503 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3" exitCode=0 Jul 08 19:40:52.732537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732530 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c" exitCode=0 Jul 08 19:40:52.732537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732537 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d" exitCode=0 Jul 08 19:40:52.732537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732543 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c" exitCode=0 Jul 08 19:40:52.732537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732548 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac" exitCode=0 Jul 08 19:40:52.732816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3"} Jul 08 19:40:52.732816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c"} Jul 08 19:40:52.732816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d"} Jul 08 19:40:52.732816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c"} Jul 08 19:40:52.732816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:52.732747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac"} Jul 08 19:40:53.737431 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.737397 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:53.739286 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.739260 2559 generic.go:356] "Generic (PLEG): container finished" podID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerID="c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99" exitCode=0 Jul 08 19:40:53.739397 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.739330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99"} Jul 08 19:40:53.739435 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.739402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5","Type":"ContainerDied","Data":"b6b7874cfdce4e9696a333fc2d02b4994465c593ba54d69d31062f0af84b432d"} Jul 08 19:40:53.739467 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.739436 2559 scope.go:117] "RemoveContainer" containerID="ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3" Jul 08 19:40:53.747069 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.747050 2559 scope.go:117] "RemoveContainer" containerID="419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c" Jul 08 19:40:53.755556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.755536 2559 scope.go:117] "RemoveContainer" containerID="3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d" Jul 08 19:40:53.762447 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.762427 2559 scope.go:117] "RemoveContainer" containerID="c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99" Jul 08 19:40:53.769549 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.769493 2559 scope.go:117] "RemoveContainer" containerID="8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c" Jul 08 19:40:53.778499 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.778478 2559 scope.go:117] "RemoveContainer" containerID="172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac" Jul 08 19:40:53.787613 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.787593 2559 scope.go:117] "RemoveContainer" containerID="0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2" Jul 08 19:40:53.795098 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.795073 2559 scope.go:117] "RemoveContainer" containerID="ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3" Jul 08 19:40:53.795435 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.795413 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3\": container with ID starting with ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3 not found: ID does not exist" containerID="ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3" Jul 08 19:40:53.795504 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.795444 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3"} err="failed to get container status \"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3\": rpc error: code = NotFound desc = could not find container \"ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3\": container with ID starting with ce603d491516802c340dc135bccfb2d368a3d28f9b3a570be2f1a095ac1824a3 not found: ID does not exist" Jul 08 19:40:53.795504 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.795479 2559 scope.go:117] "RemoveContainer" containerID="419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c" Jul 08 19:40:53.795736 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.795715 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c\": container with ID starting with 419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c not found: ID does not exist" containerID="419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c" Jul 08 19:40:53.795818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.795741 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c"} err="failed to get container status \"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c\": rpc error: code = NotFound desc = could not find container \"419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c\": container with ID starting with 419610963d32ff62985f7488d4e885917fe5d330cc3ad7eed400ed9dbc84141c not found: ID does not exist" Jul 08 19:40:53.795818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.795758 2559 scope.go:117] "RemoveContainer" containerID="3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d" Jul 08 19:40:53.796003 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.795985 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d\": container with ID starting with 3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d not found: ID does not exist" containerID="3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d" Jul 08 19:40:53.796038 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796009 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d"} err="failed to get container status \"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d\": rpc error: code = NotFound desc = could not find container \"3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d\": container with ID starting with 3cafd9fc0f8667634234da194c17a1847a5fad2899a135132b3f22238642e46d not found: ID does not exist" Jul 08 19:40:53.796038 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796025 2559 scope.go:117] "RemoveContainer" containerID="c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99" Jul 08 19:40:53.796319 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.796296 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99\": container with ID starting with c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99 not found: ID does not exist" containerID="c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99" Jul 08 19:40:53.796376 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796327 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99"} err="failed to get container status \"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99\": rpc error: code = NotFound desc = could not find container \"c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99\": container with ID starting with c7a248255f18b896f446dbaec8eb7aff53dc289a8fa0cdc5638cce20057dac99 not found: ID does not exist" Jul 08 19:40:53.796376 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796348 2559 scope.go:117] "RemoveContainer" containerID="8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c" Jul 08 19:40:53.796606 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.796586 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c\": container with ID starting with 8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c not found: ID does not exist" containerID="8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c" Jul 08 19:40:53.796678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796610 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c"} err="failed to get container status \"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c\": rpc error: code = NotFound desc = could not find container \"8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c\": container with ID starting with 8e2e952233d001823b6a9f013b153ac2e291dae396f6d84d82fdaf412d5dee1c not found: ID does not exist" Jul 08 19:40:53.796678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796625 2559 scope.go:117] "RemoveContainer" containerID="172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac" Jul 08 19:40:53.796870 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.796852 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac\": container with ID starting with 172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac not found: ID does not exist" containerID="172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac" Jul 08 19:40:53.796914 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796875 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac"} err="failed to get container status \"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac\": rpc error: code = NotFound desc = could not find container \"172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac\": container with ID starting with 172fa5970880b121d41ae7325be573c99dccb7e752693360993ee7f6df25d0ac not found: ID does not exist" Jul 08 19:40:53.796914 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.796888 2559 scope.go:117] "RemoveContainer" containerID="0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2" Jul 08 19:40:53.797105 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:53.797091 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2\": container with ID starting with 0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2 not found: ID does not exist" containerID="0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2" Jul 08 19:40:53.797146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.797108 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2"} err="failed to get container status \"0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2\": rpc error: code = NotFound desc = could not find container \"0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2\": container with ID starting with 0bc8cc90ce2bf0616e25f63e0356c9263ab3c1e11da2669b35b30fa01e9656a2 not found: ID does not exist" Jul 08 19:40:53.865763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865666 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.865763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865717 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.865763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865738 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865789 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.865969 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866081 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866120 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866169 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866260 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.866300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.866288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz2k9\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9\") pod \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\" (UID: \"7c84cabe-ffe9-447d-a152-d42ae1dbe3d5\") " Jul 08 19:40:53.867984 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.867419 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:53.867984 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.867724 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:53.867984 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.867894 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:53.869843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.869681 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume" (OuterVolumeSpecName: "config-volume") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.869843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.869721 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.869843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.869767 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.869843 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.869783 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.870129 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.869985 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9" (OuterVolumeSpecName: "kube-api-access-bz2k9") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "kube-api-access-bz2k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:53.870357 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.870330 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:53.870486 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.870452 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.870799 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.870780 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out" (OuterVolumeSpecName: "config-out") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:53.874717 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.874280 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.880876 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.880854 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config" (OuterVolumeSpecName: "web-config") pod "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" (UID: "7c84cabe-ffe9-447d-a152-d42ae1dbe3d5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:53.967338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967280 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-volume\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967329 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-cluster-tls-config\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967338 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967343 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967357 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967372 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-main-tls\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967383 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-web-config\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967395 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967405 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-tls-assets\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967416 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-config-out\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967426 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967438 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-alertmanager-main-db\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967449 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-metrics-client-ca\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:53.967608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:53.967462 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz2k9\" (UniqueName: \"kubernetes.io/projected/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5-kube-api-access-bz2k9\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:54.155459 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:54.155376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:54.221465 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:54.221434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:54.744495 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:54.744467 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.768626 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:54.768561 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:54.774254 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:54.774226 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:55.547557 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:55.547523 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" path="/var/lib/kubelet/pods/7c84cabe-ffe9-447d-a152-d42ae1dbe3d5/volumes" Jul 08 19:40:56.791511 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791471 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:56.791987 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791845 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="prometheus" containerID="cri-o://9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" gracePeriod=600 Jul 08 19:40:56.791987 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791879 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="config-reloader" containerID="cri-o://e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" gracePeriod=600 Jul 08 19:40:56.791987 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791917 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy" containerID="cri-o://d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" gracePeriod=600 Jul 08 19:40:56.792134 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791879 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-web" containerID="cri-o://8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" gracePeriod=600 Jul 08 19:40:56.792134 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791879 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="thanos-sidecar" containerID="cri-o://c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" gracePeriod=600 Jul 08 19:40:56.792134 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:56.791879 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" gracePeriod=600 Jul 08 19:40:57.031084 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.031059 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.096615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096528 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096615 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096566 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096662 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096690 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096723 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096775 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.096818 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096808 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096843 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096869 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096898 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096921 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096949 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.096985 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097048 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097073 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zhkl\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097114 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097096 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097122 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097146 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file\") pod \"b288f412-4515-49b9-8fa6-69cc355ab9d8\" (UID: \"b288f412-4515-49b9-8fa6-69cc355ab9d8\") " Jul 08 19:40:57.097756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097302 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.097756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097479 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.097756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.097685 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.098827 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.098325 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:57.099104 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.099081 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.100278 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100251 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.100425 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100398 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.100613 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100330 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.100714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100668 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:57.100714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100666 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.100714 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.100630 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.101142 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.101086 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.101557 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.101530 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.102318 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102279 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl" (OuterVolumeSpecName: "kube-api-access-8zhkl") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "kube-api-access-8zhkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:57.102318 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102298 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.102705 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102680 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.102778 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102701 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.102927 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102900 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config" (OuterVolumeSpecName: "config") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.103007 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.102903 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out" (OuterVolumeSpecName: "config-out") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:57.103366 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.103351 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:57.112720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.112693 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config" (OuterVolumeSpecName: "web-config") pod "b288f412-4515-49b9-8fa6-69cc355ab9d8" (UID: "b288f412-4515-49b9-8fa6-69cc355ab9d8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:57.198845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198799 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-kube-rbac-proxy\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.198845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198842 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-config-out\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.198845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198853 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.198845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198863 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198871 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-config\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198879 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198889 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198897 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-grpc-tls\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198904 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-metrics-client-ca\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198913 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198921 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zhkl\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-kube-api-access-8zhkl\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198929 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b288f412-4515-49b9-8fa6-69cc355ab9d8-tls-assets\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198938 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b288f412-4515-49b9-8fa6-69cc355ab9d8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198946 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198954 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b288f412-4515-49b9-8fa6-69cc355ab9d8-prometheus-k8s-db\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198962 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198970 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-web-config\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198978 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-metrics-client-certs\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.199102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.198986 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b288f412-4515-49b9-8fa6-69cc355ab9d8-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:40:57.400083 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.399987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:40:57.402422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.402401 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc37c758-7eff-42f2-9c79-6383b3c01abf-metrics-certs\") pod \"network-metrics-daemon-2b7nn\" (UID: \"fc37c758-7eff-42f2-9c79-6383b3c01abf\") " pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:40:57.445089 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.445064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6785\"" Jul 08 19:40:57.452753 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.452730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b7nn" Jul 08 19:40:57.602250 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.602147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b7nn"] Jul 08 19:40:57.608141 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:40:57.608118 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc37c758_7eff_42f2_9c79_6383b3c01abf.slice/crio-e05ff2ecf9e2760294aaa6d88b01ea3e12e5aba1743bcf77e0de9e09c6bc968d WatchSource:0}: Error finding container e05ff2ecf9e2760294aaa6d88b01ea3e12e5aba1743bcf77e0de9e09c6bc968d: Status 404 returned error can't find the container with id e05ff2ecf9e2760294aaa6d88b01ea3e12e5aba1743bcf77e0de9e09c6bc968d Jul 08 19:40:57.610002 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.609985 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:40:57.756197 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.756141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b7nn" event={"ID":"fc37c758-7eff-42f2-9c79-6383b3c01abf","Type":"ContainerStarted","Data":"e05ff2ecf9e2760294aaa6d88b01ea3e12e5aba1743bcf77e0de9e09c6bc968d"} Jul 08 19:40:57.759270 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759242 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" exitCode=0 Jul 08 19:40:57.759270 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759268 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" exitCode=0 Jul 08 19:40:57.759270 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759275 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" exitCode=0 Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759281 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" exitCode=0 Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759286 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" exitCode=0 Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759291 2559 generic.go:356] "Generic (PLEG): container finished" podID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" exitCode=0 Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759343 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759457 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759468 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.759482 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} Jul 08 19:40:57.759900 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.759502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b288f412-4515-49b9-8fa6-69cc355ab9d8","Type":"ContainerDied","Data":"32e78b769b479110ff6356ea27ba27ce32cea7d9d07bb8bccd4189e4bab73a5c"} Jul 08 19:40:57.767650 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.767623 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.774528 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.774511 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.780955 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.780934 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:57.782124 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.782104 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.787588 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.787567 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:57.788951 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.788932 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.795798 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.795657 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.802398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.802382 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.816962 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.816941 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:57.817271 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817257 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="prom-label-proxy" Jul 08 19:40:57.817325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817273 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="prom-label-proxy" Jul 08 19:40:57.817325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817281 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="thanos-sidecar" Jul 08 19:40:57.817325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817286 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="thanos-sidecar" Jul 08 19:40:57.817325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817318 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="prometheus" Jul 08 19:40:57.817325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817324 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="prometheus" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817330 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817335 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817342 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817347 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817355 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="alertmanager" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817361 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="alertmanager" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817368 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="init-config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817372 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="init-config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817379 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-thanos" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817383 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-thanos" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817389 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="init-config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817394 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="init-config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817402 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817409 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817421 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-metric" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817429 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-metric" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817441 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817448 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817455 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817461 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817469 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="config-reloader" Jul 08 19:40:57.817493 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817475 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="config-reloader" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817525 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="alertmanager" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817533 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817539 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="prom-label-proxy" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817546 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817551 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817557 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="config-reloader" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817562 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="config-reloader" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817567 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="prometheus" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817572 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-metric" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817577 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c84cabe-ffe9-447d-a152-d42ae1dbe3d5" containerName="kube-rbac-proxy-web" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817582 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="thanos-sidecar" Jul 08 19:40:57.818103 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.817586 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" containerName="kube-rbac-proxy-thanos" Jul 08 19:40:57.819864 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.819849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.823500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823432 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 19:40:57.823599 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 19:40:57.823599 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823484 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 19:40:57.823724 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 19:40:57.824116 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823945 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 19:40:57.824116 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2xp5m\"" Jul 08 19:40:57.824116 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.823955 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 19:40:57.824116 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.824095 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 19:40:57.824487 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.824466 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 19:40:57.824596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.824505 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 19:40:57.824659 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.824609 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 19:40:57.824659 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.824649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 19:40:57.825030 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.825013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 19:40:57.825385 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.825366 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3o4vedrrd6sns\"" Jul 08 19:40:57.825500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.825480 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 19:40:57.826156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.826138 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 19:40:57.826612 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.826583 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.826948 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.826926 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.827034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.826959 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.827034 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.826984 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.827471 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.827452 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.827553 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.827480 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.827553 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.827503 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.828166 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.828139 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.828274 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.828243 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.828274 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.828272 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.828801 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.828700 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.828801 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.828728 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.828801 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.828749 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.829204 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.829168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 19:40:57.829548 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.829527 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.829677 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.829555 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.829677 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.829575 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.829845 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.829827 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.829908 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.829849 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.829908 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.829871 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.830094 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:40:57.830070 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.830135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830096 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.830135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830108 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.830345 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830318 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.830407 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830348 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.830584 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830569 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.830624 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830584 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.830893 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830876 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.830952 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.830894 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.831193 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831142 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.831240 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831193 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.831440 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831421 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.831497 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831441 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.831679 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831661 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.831679 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831677 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.831894 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831876 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.831947 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.831894 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.832091 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832076 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.832135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832091 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.832324 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832310 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.832385 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832324 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.832540 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832523 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.832583 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832540 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.832743 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832728 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.832743 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832742 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.832934 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832918 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.832976 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.832935 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.833143 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833125 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.833195 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833144 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.833382 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833365 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.833382 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833381 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.833569 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833555 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.833609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833569 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.833780 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833761 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.833815 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833781 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.833982 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833965 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.834021 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.833983 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.834199 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834165 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.834240 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834201 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.834420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834398 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.834466 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834421 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.834628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834612 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.834664 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834628 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.834839 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834816 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.834878 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.834839 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.835032 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835017 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.835073 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835032 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.835252 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835237 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.835300 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835252 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.835484 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835465 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.835537 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835485 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.835678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835662 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.835678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835678 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.835880 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835866 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.835920 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.835882 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.836093 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836076 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.836142 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836093 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.836295 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836275 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.836351 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836300 2559 scope.go:117] "RemoveContainer" containerID="63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd" Jul 08 19:40:57.836506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836487 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd"} err="failed to get container status \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": rpc error: code = NotFound desc = could not find container \"63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd\": container with ID starting with 63fbfe28df805c1961f86912b253224ffc20a406d29df55e68782b6bac915fcd not found: ID does not exist" Jul 08 19:40:57.836506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836505 2559 scope.go:117] "RemoveContainer" containerID="d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4" Jul 08 19:40:57.836866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836844 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4"} err="failed to get container status \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": rpc error: code = NotFound desc = could not find container \"d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4\": container with ID starting with d8e36b21523b72cb69382728952d1272f6f961bb06f5eff353e9225e83c54fb4 not found: ID does not exist" Jul 08 19:40:57.836954 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.836867 2559 scope.go:117] "RemoveContainer" containerID="8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e" Jul 08 19:40:57.837170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837150 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e"} err="failed to get container status \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": rpc error: code = NotFound desc = could not find container \"8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e\": container with ID starting with 8e59ae5a7bfdca0572e47de04ccad0c2ec9ea1493bec6cc8bba762271958853e not found: ID does not exist" Jul 08 19:40:57.837170 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837169 2559 scope.go:117] "RemoveContainer" containerID="c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145" Jul 08 19:40:57.837444 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837418 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145"} err="failed to get container status \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": rpc error: code = NotFound desc = could not find container \"c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145\": container with ID starting with c942bfdd8aef0f1085ac320013675242987eabe68830ac28e1c5633e2282d145 not found: ID does not exist" Jul 08 19:40:57.837530 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837445 2559 scope.go:117] "RemoveContainer" containerID="e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644" Jul 08 19:40:57.837745 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837721 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644"} err="failed to get container status \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": rpc error: code = NotFound desc = could not find container \"e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644\": container with ID starting with e32b63965703e527c6aacca5b2b7ea2b68e31546bcca4858ba46ff132eff2644 not found: ID does not exist" Jul 08 19:40:57.837745 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.837747 2559 scope.go:117] "RemoveContainer" containerID="9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e" Jul 08 19:40:57.838152 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.838133 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e"} err="failed to get container status \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": rpc error: code = NotFound desc = could not find container \"9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e\": container with ID starting with 9e2b0d777a72f53b007f1488ac02d9951567ebea369d0f608cc93dc3cc67568e not found: ID does not exist" Jul 08 19:40:57.838152 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.838152 2559 scope.go:117] "RemoveContainer" containerID="05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1" Jul 08 19:40:57.838422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.838402 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1"} err="failed to get container status \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": rpc error: code = NotFound desc = could not find container \"05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1\": container with ID starting with 05d3bc852b262fa72bcc5b036c7f4af07ea5c643979c5984dfc7b4e2fd832ed1 not found: ID does not exist" Jul 08 19:40:57.839264 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.839246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:57.904820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.904820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904906 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.904984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndb4\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-kube-api-access-lndb4\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:57.905332 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:57.905293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.005997 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.005964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.005997 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.005994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndb4\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-kube-api-access-lndb4\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006491 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006580 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.006925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.006713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.007329 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.008434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009552 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.009422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009552 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.009467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009552 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.009496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009552 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.009532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.009981 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.009958 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.010364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.010313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.010466 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.010432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.010681 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.010652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.010975 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.010950 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.011408 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.011371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.011584 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.011562 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.011796 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.011773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.012497 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.012473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.012693 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.012675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-config\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.012917 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.012896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.013070 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.013056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.015509 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.015491 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndb4\" (UniqueName: \"kubernetes.io/projected/eb07ed2b-72d5-476b-b2b8-69c6a1af765a-kube-api-access-lndb4\") pod \"prometheus-k8s-0\" (UID: \"eb07ed2b-72d5-476b-b2b8-69c6a1af765a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.131815 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.131775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:40:58.291353 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.291226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 19:40:58.294702 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:40:58.294665 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb07ed2b_72d5_476b_b2b8_69c6a1af765a.slice/crio-ef0930c4065e8fd7e7acc4597da12a408921f7af65582c729c2f77df37169950 WatchSource:0}: Error finding container ef0930c4065e8fd7e7acc4597da12a408921f7af65582c729c2f77df37169950: Status 404 returned error can't find the container with id ef0930c4065e8fd7e7acc4597da12a408921f7af65582c729c2f77df37169950 Jul 08 19:40:58.766461 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.766420 2559 generic.go:356] "Generic (PLEG): container finished" podID="eb07ed2b-72d5-476b-b2b8-69c6a1af765a" containerID="414eab898961f83bebd08504a3a058fc5d387941c1a6ddf0ab2d76db45e03fe3" exitCode=0 Jul 08 19:40:58.766652 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.766524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerDied","Data":"414eab898961f83bebd08504a3a058fc5d387941c1a6ddf0ab2d76db45e03fe3"} Jul 08 19:40:58.766652 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:58.766621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"ef0930c4065e8fd7e7acc4597da12a408921f7af65582c729c2f77df37169950"} Jul 08 19:40:59.546823 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.546793 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b288f412-4515-49b9-8fa6-69cc355ab9d8" path="/var/lib/kubelet/pods/b288f412-4515-49b9-8fa6-69cc355ab9d8/volumes" Jul 08 19:40:59.774546 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.774499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b7nn" event={"ID":"fc37c758-7eff-42f2-9c79-6383b3c01abf","Type":"ContainerStarted","Data":"e68e62e1c401f8f21c9e4f6375cb087e09b76290c8a6aad903674a26f69a15a8"} Jul 08 19:40:59.774749 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.774568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b7nn" event={"ID":"fc37c758-7eff-42f2-9c79-6383b3c01abf","Type":"ContainerStarted","Data":"1fb51d6921cd73309a1cd894da2a5674df6c79409d4f5a0b4df1bf3e6cedfefd"} Jul 08 19:40:59.777569 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777544 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"0996f616f0dc5ca9e38d2623f4ea8a6849345461c89865cbc2fa1f1ad896a828"} Jul 08 19:40:59.777660 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"f2d624320664c70af5fd4355f9ab550248871d45745890634e4601f7edeaea53"} Jul 08 19:40:59.777660 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"faf475a3b82215a405067e28885cc39f03216bd6ffddf6920dab4d409e5c6f4b"} Jul 08 19:40:59.777660 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777654 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"e9c80b70d45f391d097729ef1f9dab50184b85ab4e8e2fe2a17e55f907b07941"} Jul 08 19:40:59.777784 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"57e715b52c34c3fa64255fe8ad63c70105a733f43bf7e0b6ed67667782893cc1"} Jul 08 19:40:59.777784 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.777707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb07ed2b-72d5-476b-b2b8-69c6a1af765a","Type":"ContainerStarted","Data":"031ad1062ea729ce88e1c9ff1c0cce682dd7b05bd5607a2644932a003887db52"} Jul 08 19:40:59.792220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.792151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2b7nn" podStartSLOduration=375.577642194 podStartE2EDuration="6m16.792136617s" totalImagesPullingTime="1.214494423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:40:59.790979847 +0000 UTC m=+376.778783718" watchObservedRunningTime="2026-07-08 19:40:59.792136617 +0000 UTC m=+376.779940489" Jul 08 19:40:59.820807 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.820689 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.801017586 podStartE2EDuration="2.820667221s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.649635ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:40:59.818198088 +0000 UTC m=+376.806001961" watchObservedRunningTime="2026-07-08 19:40:59.820667221 +0000 UTC m=+376.808471092" Jul 08 19:40:59.895053 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.895023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:59.999676 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:40:59.999642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:00.238442 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:00.238358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:00.307417 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:00.307387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:02.262135 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:02.262109 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:02.362774 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:02.362738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:02.464977 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:02.464946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:03.131972 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:03.131922 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:41:06.608842 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:06.608808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.412558 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:14.412520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.511506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:14.511473 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:27.933033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:27.932997 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:27.990239 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:27.990203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:37.221463 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:37.221424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:37.321577 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:37.321545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:58.132405 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:58.132316 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:41:58.148582 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:58.148554 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:41:59.026213 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:41:59.026168 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 19:42:12.114740 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:12.114655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:13.530292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:13.530264 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:15.734806 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:15.734764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:15.834824 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:15.834765 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:17.525558 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:17.525526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:17.621692 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:17.621666 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:17.795095 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:17.795024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:17.935299 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:17.935267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:19.734322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:19.734294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:19.920363 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:19.920331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:22.721825 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:22.721781 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:22.778999 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:22.778972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:28.138812 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:28.138784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:29.125552 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:29.125521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:29.226246 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:29.226213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:35.260680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:35.260640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:35.362160 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:35.362129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:37.018519 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:37.018484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:50.008939 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:50.008910 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:53.226612 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:53.226575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:53.327252 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:53.327224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:53.966607 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:53.966573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:54.058982 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:54.058958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:54.788581 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:54.788550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:54.997734 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:54.997700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.101716 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.101634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.147271 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.147244 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd"] Jul 08 19:42:55.150355 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.150340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.153393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.153372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:42:55.153526 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.153394 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:42:55.153526 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.153490 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:42:55.154241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.154217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lwpjc\"" Jul 08 19:42:55.154572 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.154314 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:42:55.167740 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.167719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd"] Jul 08 19:42:55.273881 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.273857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.274010 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.273886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.274010 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.273908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.274010 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.273981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.274168 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.274012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czq6\" (UniqueName: \"kubernetes.io/projected/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-kube-api-access-2czq6\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.276878 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.276853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.373867 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.373777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.374905 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.374882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.375014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.374914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czq6\" (UniqueName: \"kubernetes.io/projected/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-kube-api-access-2czq6\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.375014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.374968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.375014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.374989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.375014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.375010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.375496 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.375457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.377504 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.377481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.377739 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.377720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.377829 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.377807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.383885 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.383866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czq6\" (UniqueName: \"kubernetes.io/projected/876ba3a7-eb2c-4326-a942-e0f75d0bf06c-kube-api-access-2czq6\") pod \"opendatahub-operator-controller-manager-5d8f46d496-8c7vd\" (UID: \"876ba3a7-eb2c-4326-a942-e0f75d0bf06c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.463663 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.463639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:42:55.475083 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.475047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.582962 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.582933 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.622966 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.622945 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd"] Jul 08 19:42:55.625241 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:42:55.625167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876ba3a7_eb2c_4326_a942_e0f75d0bf06c.slice/crio-ff083abc3ce30c81598ce261a0aa004c43b7e5f8acbedca0132bbc394e4b2a93 WatchSource:0}: Error finding container ff083abc3ce30c81598ce261a0aa004c43b7e5f8acbedca0132bbc394e4b2a93: Status 404 returned error can't find the container with id ff083abc3ce30c81598ce261a0aa004c43b7e5f8acbedca0132bbc394e4b2a93 Jul 08 19:42:55.681500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.681476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:55.774022 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:55.773995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:56.234908 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:56.234867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" event={"ID":"876ba3a7-eb2c-4326-a942-e0f75d0bf06c","Type":"ContainerStarted","Data":"ff083abc3ce30c81598ce261a0aa004c43b7e5f8acbedca0132bbc394e4b2a93"} Jul 08 19:42:59.250733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:42:59.250693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" event={"ID":"876ba3a7-eb2c-4326-a942-e0f75d0bf06c","Type":"ContainerStarted","Data":"3ad5d736c58e6574e8cd57c4b57cc0a8e4c51a2b5c8c110e304872a7105d9e69"} Jul 08 19:43:00.256629 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:00.256594 2559 generic.go:356] "Generic (PLEG): container finished" podID="876ba3a7-eb2c-4326-a942-e0f75d0bf06c" containerID="3ad5d736c58e6574e8cd57c4b57cc0a8e4c51a2b5c8c110e304872a7105d9e69" exitCode=0 Jul 08 19:43:00.257084 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:00.256638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" event={"ID":"876ba3a7-eb2c-4326-a942-e0f75d0bf06c","Type":"ContainerDied","Data":"3ad5d736c58e6574e8cd57c4b57cc0a8e4c51a2b5c8c110e304872a7105d9e69"} Jul 08 19:43:01.263007 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:01.262967 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" event={"ID":"876ba3a7-eb2c-4326-a942-e0f75d0bf06c","Type":"ContainerStarted","Data":"634e897b80e6032de5bc08513af4a7ca6a3151ad3978d1e21c7614902097d0af"} Jul 08 19:43:01.263475 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:01.263082 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:43:01.291196 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:01.291135 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" podStartSLOduration=1.871215747 podStartE2EDuration="6.291117829s" totalImagesPullingTime="3.341655905s" totalInitContainerRuntime="1.078246177s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:01.289560956 +0000 UTC m=+498.277364863" watchObservedRunningTime="2026-07-08 19:43:01.291117829 +0000 UTC m=+498.278921701" Jul 08 19:43:05.635049 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:05.635017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:05.730462 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:05.730432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:07.289147 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:07.289114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:07.463187 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:07.463143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:12.269758 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:12.269726 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-8c7vd" Jul 08 19:43:14.541064 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:14.541014 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:14.695234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:14.695197 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:14.956502 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:14.956412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:15.471032 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:15.471001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:15.587370 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:15.587343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:15.928889 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:15.928860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.047322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.047272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.394393 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.394361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.557277 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.557247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.594190 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.594143 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:16.600525 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.600507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.603331 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.603310 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 19:43:16.603331 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.603323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 19:43:16.603522 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.603390 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:43:16.603522 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.603434 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5v2km\"" Jul 08 19:43:16.603637 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.603581 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 19:43:16.614832 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.614811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:16.673804 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.673714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.761032 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.760993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl22d\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761236 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.761429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.761253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.766007 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.765984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:16.862442 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862442 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl22d\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.862703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.862605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.863310 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.863283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.865067 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.865041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.865166 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.865047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.865166 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.865093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.865166 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.865156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.871556 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.871532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.872015 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.871994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl22d\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d\") pod \"istiod-openshift-gateway-7574459656-gptd4\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:16.910039 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:16.910007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:17.065396 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:17.065370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:17.067439 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:43:17.067410 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3f6293_91a5_4ea1_82cf_35196083c5a7.slice/crio-275dd9943e7341b23273f02e8c44d41a44c5311ca7f0719103743bde6c90c31f WatchSource:0}: Error finding container 275dd9943e7341b23273f02e8c44d41a44c5311ca7f0719103743bde6c90c31f: Status 404 returned error can't find the container with id 275dd9943e7341b23273f02e8c44d41a44c5311ca7f0719103743bde6c90c31f Jul 08 19:43:17.329233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:17.329195 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" event={"ID":"df3f6293-91a5-4ea1-82cf-35196083c5a7","Type":"ContainerStarted","Data":"275dd9943e7341b23273f02e8c44d41a44c5311ca7f0719103743bde6c90c31f"} Jul 08 19:43:17.865596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:17.865554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:19.335869 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:19.335820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:19.396616 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:19.396576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:19.499191 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:19.499136 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:43:19.499309 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:19.499231 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:43:20.344314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.344276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" event={"ID":"df3f6293-91a5-4ea1-82cf-35196083c5a7","Type":"ContainerStarted","Data":"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e"} Jul 08 19:43:20.344696 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.344461 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:20.346380 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.346350 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-gptd4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 19:43:20.346517 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.346414 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:43:20.394202 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.394125 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" podStartSLOduration=1.964789416 podStartE2EDuration="4.394110192s" totalImagesPullingTime="2.429320776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:20.393416759 +0000 UTC m=+517.381220626" watchObservedRunningTime="2026-07-08 19:43:20.394110192 +0000 UTC m=+517.381914063" Jul 08 19:43:20.395069 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.395045 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:20.490088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.490060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:20.595790 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.595711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:20.688133 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.688104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:20.916429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:20.916351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:21.349487 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:21.349464 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:22.203774 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.203739 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r"] Jul 08 19:43:22.207295 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.207277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.211444 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.211423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:43:22.212662 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.212644 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 19:43:22.212780 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.212762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 19:43:22.212845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.212763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:43:22.212845 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.212816 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 19:43:22.212933 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.212662 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-26rjj\"" Jul 08 19:43:22.227570 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.227548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r"] Jul 08 19:43:22.315765 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.315716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcn4\" (UniqueName: \"kubernetes.io/projected/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-kube-api-access-lxcn4\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.315765 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.315758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.315765 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.315775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-metrics-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.316064 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.315925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-manager-config\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.416600 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.416565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcn4\" (UniqueName: \"kubernetes.io/projected/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-kube-api-access-lxcn4\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.416600 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.416605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.417054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.416627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-metrics-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.417054 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.416739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-manager-config\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.417417 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.417399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-manager-config\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.419322 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.419301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.419429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.419374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-metrics-cert\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.425577 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.425546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcn4\" (UniqueName: \"kubernetes.io/projected/65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1-kube-api-access-lxcn4\") pod \"lws-controller-manager-69bd7c86d9-z546r\" (UID: \"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1\") " pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.515993 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.515970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:22.648188 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:22.648151 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r"] Jul 08 19:43:22.650357 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:43:22.650331 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65dc98e4_82dc_494b_bd21_3f2b5a8ec0f1.slice/crio-42f49ac6fdbb3565a8bfd7d44f75c403938d4fffc71c1f5cbfac123c16275908 WatchSource:0}: Error finding container 42f49ac6fdbb3565a8bfd7d44f75c403938d4fffc71c1f5cbfac123c16275908: Status 404 returned error can't find the container with id 42f49ac6fdbb3565a8bfd7d44f75c403938d4fffc71c1f5cbfac123c16275908 Jul 08 19:43:23.359819 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:23.359781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" event={"ID":"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1","Type":"ContainerStarted","Data":"42f49ac6fdbb3565a8bfd7d44f75c403938d4fffc71c1f5cbfac123c16275908"} Jul 08 19:43:25.369500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:25.369414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" event={"ID":"65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1","Type":"ContainerStarted","Data":"f40ece67a8e20e48a27e5595af1a93d7792e26de1d450a398e167370b392d74e"} Jul 08 19:43:25.369868 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:25.369558 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:25.403590 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:25.403546 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" podStartSLOduration=1.007284463 podStartE2EDuration="3.403530891s" totalImagesPullingTime="2.396246428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:25.402535324 +0000 UTC m=+522.390339200" watchObservedRunningTime="2026-07-08 19:43:25.403530891 +0000 UTC m=+522.391334762" Jul 08 19:43:26.631968 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:26.631941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:26.811962 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:26.811930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:27.124119 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:27.124093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:27.294006 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:27.293972 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:28.003578 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:28.003544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:28.099079 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:28.099050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:28.184806 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:28.184774 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:29.887269 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:29.887239 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:29.887664 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:29.887432 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerName="discovery" containerID="cri-o://32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e" gracePeriod=30 Jul 08 19:43:30.129144 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.129120 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:30.188547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl22d\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188510 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188539 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188560 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188597 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188621 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.188820 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.188639 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs\") pod \"df3f6293-91a5-4ea1-82cf-35196083c5a7\" (UID: \"df3f6293-91a5-4ea1-82cf-35196083c5a7\") " Jul 08 19:43:30.189071 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.189040 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:43:30.191016 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.190969 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts" (OuterVolumeSpecName: "cacerts") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:43:30.191154 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.191041 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:43:30.191296 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.191275 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:43:30.191364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.191328 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:43:30.191420 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.191368 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d" (OuterVolumeSpecName: "kube-api-access-vl22d") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "kube-api-access-vl22d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:43:30.191467 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.191413 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs" (OuterVolumeSpecName: "local-certs") pod "df3f6293-91a5-4ea1-82cf-35196083c5a7" (UID: "df3f6293-91a5-4ea1-82cf-35196083c5a7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:43:30.290040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.289985 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl22d\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-kube-api-access-vl22d\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290032 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-cacerts\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290040 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290046 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-dns-cert\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290060 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-token\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290073 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-csr-ca-configmap\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290084 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f6293-91a5-4ea1-82cf-35196083c5a7-istio-kubeconfig\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.290325 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.290095 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f6293-91a5-4ea1-82cf-35196083c5a7-local-certs\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:43:30.391066 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.391016 2559 generic.go:356] "Generic (PLEG): container finished" podID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerID="32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e" exitCode=0 Jul 08 19:43:30.391066 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.391056 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" Jul 08 19:43:30.391290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.391116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" event={"ID":"df3f6293-91a5-4ea1-82cf-35196083c5a7","Type":"ContainerDied","Data":"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e"} Jul 08 19:43:30.391290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.391163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gptd4" event={"ID":"df3f6293-91a5-4ea1-82cf-35196083c5a7","Type":"ContainerDied","Data":"275dd9943e7341b23273f02e8c44d41a44c5311ca7f0719103743bde6c90c31f"} Jul 08 19:43:30.391290 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.391216 2559 scope.go:117] "RemoveContainer" containerID="32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e" Jul 08 19:43:30.400146 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.400131 2559 scope.go:117] "RemoveContainer" containerID="32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e" Jul 08 19:43:30.400415 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:43:30.400397 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e\": container with ID starting with 32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e not found: ID does not exist" containerID="32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e" Jul 08 19:43:30.400485 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.400422 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e"} err="failed to get container status \"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e\": rpc error: code = NotFound desc = could not find container \"32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e\": container with ID starting with 32d58b505004ed941af79eb4d15f0f06367bb754ede0917ffd54e7488a33f89e not found: ID does not exist" Jul 08 19:43:30.422421 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.422385 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:30.423700 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:30.423672 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gptd4"] Jul 08 19:43:31.546880 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:31.546850 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" path="/var/lib/kubelet/pods/df3f6293-91a5-4ea1-82cf-35196083c5a7/volumes" Jul 08 19:43:36.376122 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:36.376052 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bd7c86d9-z546r" Jul 08 19:43:40.742241 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:40.742211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:41.458994 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:41.458960 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:43:56.572812 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:43:56.572775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:16.039288 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.039254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:16.150367 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.150331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:16.218224 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.218189 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:16.218589 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.218576 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerName="discovery" Jul 08 19:44:16.218634 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.218590 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerName="discovery" Jul 08 19:44:16.218667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.218649 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df3f6293-91a5-4ea1-82cf-35196083c5a7" containerName="discovery" Jul 08 19:44:16.221756 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.221739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:16.224721 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.224697 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:44:16.224869 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.224695 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:44:16.225935 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.225911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vhb8s\"" Jul 08 19:44:16.231357 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.231332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:16.276499 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.276458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx5dt\" (UniqueName: \"kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt\") pod \"kuadrant-operator-catalog-lmb6m\" (UID: \"f3fcfe93-385e-4687-8e52-7c9cadb7322f\") " pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:16.279488 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.279466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:16.377731 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.377638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx5dt\" (UniqueName: \"kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt\") pod \"kuadrant-operator-catalog-lmb6m\" (UID: \"f3fcfe93-385e-4687-8e52-7c9cadb7322f\") " pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:16.386285 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.386256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx5dt\" (UniqueName: \"kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt\") pod \"kuadrant-operator-catalog-lmb6m\" (UID: \"f3fcfe93-385e-4687-8e52-7c9cadb7322f\") " pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:16.519855 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.519817 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:16.520140 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.520128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:16.658650 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.658606 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:16.661680 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:44:16.661655 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fcfe93_385e_4687_8e52_7c9cadb7322f.slice/crio-f8eeadd30460fb8bc1a0a0cabb6ffeabe0267cc126de86cd871042bc1cf8c580 WatchSource:0}: Error finding container f8eeadd30460fb8bc1a0a0cabb6ffeabe0267cc126de86cd871042bc1cf8c580: Status 404 returned error can't find the container with id f8eeadd30460fb8bc1a0a0cabb6ffeabe0267cc126de86cd871042bc1cf8c580 Jul 08 19:44:16.732277 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.732241 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c6gc5"] Jul 08 19:44:16.736943 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.736925 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:16.745214 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.745164 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c6gc5"] Jul 08 19:44:16.780573 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.780532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wvg\" (UniqueName: \"kubernetes.io/projected/5bf2e691-cac8-4a67-bcc4-b8af0f7c7068-kube-api-access-f6wvg\") pod \"kuadrant-operator-catalog-c6gc5\" (UID: \"5bf2e691-cac8-4a67-bcc4-b8af0f7c7068\") " pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:16.881442 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.881404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wvg\" (UniqueName: \"kubernetes.io/projected/5bf2e691-cac8-4a67-bcc4-b8af0f7c7068-kube-api-access-f6wvg\") pod \"kuadrant-operator-catalog-c6gc5\" (UID: \"5bf2e691-cac8-4a67-bcc4-b8af0f7c7068\") " pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:16.890483 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.890452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wvg\" (UniqueName: \"kubernetes.io/projected/5bf2e691-cac8-4a67-bcc4-b8af0f7c7068-kube-api-access-f6wvg\") pod \"kuadrant-operator-catalog-c6gc5\" (UID: \"5bf2e691-cac8-4a67-bcc4-b8af0f7c7068\") " pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:16.956583 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:16.956490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:17.047234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:17.047199 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:17.164576 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:17.164545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:17.191397 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:17.191370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c6gc5"] Jul 08 19:44:17.193815 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:44:17.193786 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf2e691_cac8_4a67_bcc4_b8af0f7c7068.slice/crio-c61f8304edff116a324e4c76e2b0a15d09936e48f1239d6327ff94813666871e WatchSource:0}: Error finding container c61f8304edff116a324e4c76e2b0a15d09936e48f1239d6327ff94813666871e: Status 404 returned error can't find the container with id c61f8304edff116a324e4c76e2b0a15d09936e48f1239d6327ff94813666871e Jul 08 19:44:17.583527 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:17.583489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" event={"ID":"5bf2e691-cac8-4a67-bcc4-b8af0f7c7068","Type":"ContainerStarted","Data":"c61f8304edff116a324e4c76e2b0a15d09936e48f1239d6327ff94813666871e"} Jul 08 19:44:17.584525 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:17.584498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" event={"ID":"f3fcfe93-385e-4687-8e52-7c9cadb7322f","Type":"ContainerStarted","Data":"f8eeadd30460fb8bc1a0a0cabb6ffeabe0267cc126de86cd871042bc1cf8c580"} Jul 08 19:44:19.596102 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.596059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" event={"ID":"5bf2e691-cac8-4a67-bcc4-b8af0f7c7068","Type":"ContainerStarted","Data":"7cc1f0896fdf73bcfb57dd89dd8fd24a588cfcb0f1b0c0f8d988728e065fbc49"} Jul 08 19:44:19.597568 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.597537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" event={"ID":"f3fcfe93-385e-4687-8e52-7c9cadb7322f","Type":"ContainerStarted","Data":"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6"} Jul 08 19:44:19.597705 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.597592 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" podUID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" containerName="registry-server" containerID="cri-o://9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6" gracePeriod=2 Jul 08 19:44:19.612133 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.612078 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" podStartSLOduration=1.566016751 podStartE2EDuration="3.612058277s" totalImagesPullingTime="2.046041526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:44:19.610220269 +0000 UTC m=+576.598024140" watchObservedRunningTime="2026-07-08 19:44:19.612058277 +0000 UTC m=+576.599862151" Jul 08 19:44:19.625783 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.625730 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" podStartSLOduration=1.051126914 podStartE2EDuration="3.625715407s" totalImagesPullingTime="2.574588493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:44:19.624560935 +0000 UTC m=+576.612364806" watchObservedRunningTime="2026-07-08 19:44:19.625715407 +0000 UTC m=+576.613519277" Jul 08 19:44:19.847388 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.847314 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:19.910094 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.910056 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx5dt\" (UniqueName: \"kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt\") pod \"f3fcfe93-385e-4687-8e52-7c9cadb7322f\" (UID: \"f3fcfe93-385e-4687-8e52-7c9cadb7322f\") " Jul 08 19:44:19.912447 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:19.912419 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt" (OuterVolumeSpecName: "kube-api-access-cx5dt") pod "f3fcfe93-385e-4687-8e52-7c9cadb7322f" (UID: "f3fcfe93-385e-4687-8e52-7c9cadb7322f"). InnerVolumeSpecName "kube-api-access-cx5dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:44:20.011311 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.011276 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx5dt\" (UniqueName: \"kubernetes.io/projected/f3fcfe93-385e-4687-8e52-7c9cadb7322f-kube-api-access-cx5dt\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:44:20.603664 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.603568 2559 generic.go:356] "Generic (PLEG): container finished" podID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" containerID="9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6" exitCode=0 Jul 08 19:44:20.603664 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.603619 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" Jul 08 19:44:20.603664 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.603647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" event={"ID":"f3fcfe93-385e-4687-8e52-7c9cadb7322f","Type":"ContainerDied","Data":"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6"} Jul 08 19:44:20.604206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.603690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lmb6m" event={"ID":"f3fcfe93-385e-4687-8e52-7c9cadb7322f","Type":"ContainerDied","Data":"f8eeadd30460fb8bc1a0a0cabb6ffeabe0267cc126de86cd871042bc1cf8c580"} Jul 08 19:44:20.604206 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.603710 2559 scope.go:117] "RemoveContainer" containerID="9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6" Jul 08 19:44:20.613422 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.613401 2559 scope.go:117] "RemoveContainer" containerID="9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6" Jul 08 19:44:20.613717 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:44:20.613695 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6\": container with ID starting with 9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6 not found: ID does not exist" containerID="9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6" Jul 08 19:44:20.613788 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.613731 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6"} err="failed to get container status \"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6\": rpc error: code = NotFound desc = could not find container \"9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6\": container with ID starting with 9cf5fc7e04950fc7dab4b9da37484108abaceb571ce70ef819dd41fb7e6d54e6 not found: ID does not exist" Jul 08 19:44:20.626444 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.626405 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:20.627937 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:20.627920 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lmb6m"] Jul 08 19:44:21.547233 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:21.547198 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" path="/var/lib/kubelet/pods/f3fcfe93-385e-4687-8e52-7c9cadb7322f/volumes" Jul 08 19:44:27.047608 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:27.047568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:27.048100 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:27.047632 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:27.071835 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:27.071808 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:27.658210 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:27.658158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-c6gc5" Jul 08 19:44:29.150570 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:29.150536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:45.819510 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:45.819471 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:47.504093 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:47.504057 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:47.606091 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:47.606066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:48.413222 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.413188 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc"] Jul 08 19:44:48.413510 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.413498 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" containerName="registry-server" Jul 08 19:44:48.413510 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.413511 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" containerName="registry-server" Jul 08 19:44:48.413593 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.413580 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3fcfe93-385e-4687-8e52-7c9cadb7322f" containerName="registry-server" Jul 08 19:44:48.416600 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.416586 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:48.419339 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.419310 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 19:44:48.419339 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.419331 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z6425\"" Jul 08 19:44:48.426636 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.426617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc"] Jul 08 19:44:48.552941 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.552911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn6pj\" (UniqueName: \"kubernetes.io/projected/e329b9b0-7b9c-4870-84fa-fba2093ceb25-kube-api-access-vn6pj\") pod \"dns-operator-controller-manager-864dd78c4c-kbtcc\" (UID: \"e329b9b0-7b9c-4870-84fa-fba2093ceb25\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:48.653381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.653353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn6pj\" (UniqueName: \"kubernetes.io/projected/e329b9b0-7b9c-4870-84fa-fba2093ceb25-kube-api-access-vn6pj\") pod \"dns-operator-controller-manager-864dd78c4c-kbtcc\" (UID: \"e329b9b0-7b9c-4870-84fa-fba2093ceb25\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:48.663667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.663620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn6pj\" (UniqueName: \"kubernetes.io/projected/e329b9b0-7b9c-4870-84fa-fba2093ceb25-kube-api-access-vn6pj\") pod \"dns-operator-controller-manager-864dd78c4c-kbtcc\" (UID: \"e329b9b0-7b9c-4870-84fa-fba2093ceb25\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:48.727132 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.727102 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:48.855453 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:48.855418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc"] Jul 08 19:44:48.858357 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:44:48.858329 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode329b9b0_7b9c_4870_84fa_fba2093ceb25.slice/crio-3cb8414065805205cda800636562d3e1897b82c2b5762b14bfec349d53e3e5fb WatchSource:0}: Error finding container 3cb8414065805205cda800636562d3e1897b82c2b5762b14bfec349d53e3e5fb: Status 404 returned error can't find the container with id 3cb8414065805205cda800636562d3e1897b82c2b5762b14bfec349d53e3e5fb Jul 08 19:44:49.389925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:49.389894 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.733971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:49.733882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" event={"ID":"e329b9b0-7b9c-4870-84fa-fba2093ceb25","Type":"ContainerStarted","Data":"3cb8414065805205cda800636562d3e1897b82c2b5762b14bfec349d53e3e5fb"} Jul 08 19:44:51.744994 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:51.744956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" event={"ID":"e329b9b0-7b9c-4870-84fa-fba2093ceb25","Type":"ContainerStarted","Data":"45f6f29e06b2e0b97214bae65ac97e0f79c6552e571c6a6b42e2c374305d351b"} Jul 08 19:44:51.745580 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:51.745034 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:44:51.765037 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:51.764985 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" podStartSLOduration=1.011051882 podStartE2EDuration="3.764971476s" totalImagesPullingTime="2.753919594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:44:51.762927736 +0000 UTC m=+608.750731606" watchObservedRunningTime="2026-07-08 19:44:51.764971476 +0000 UTC m=+608.752775348" Jul 08 19:44:52.321301 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:52.321265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:52.420193 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:52.420140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:52.518395 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:52.518369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:53.392401 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.392366 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh"] Jul 08 19:44:53.400571 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.400551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.403754 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.403729 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fgplz\"" Jul 08 19:44:53.406871 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.406848 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh"] Jul 08 19:44:53.501943 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.501910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrrf\" (UniqueName: \"kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.502119 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.501990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.603115 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.603087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.603303 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.603143 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrrf\" (UniqueName: \"kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.603476 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.603459 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.615329 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.615306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrrf\" (UniqueName: \"kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.711955 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.711895 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:44:53.880208 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.880160 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh"] Jul 08 19:44:53.884102 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:44:53.884073 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89f744f_dc5a_4959_b6c4_6d75c47670a1.slice/crio-ba1982f513b48c4111ec0e995240e81c40135b51f8e26a5ee543a9d6259dd5a0 WatchSource:0}: Error finding container ba1982f513b48c4111ec0e995240e81c40135b51f8e26a5ee543a9d6259dd5a0: Status 404 returned error can't find the container with id ba1982f513b48c4111ec0e995240e81c40135b51f8e26a5ee543a9d6259dd5a0 Jul 08 19:44:53.906009 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:53.905987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:54.081101 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:54.081071 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:54.361470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:54.361357 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:54.464569 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:54.464525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:54.588644 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:54.588614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:54.767209 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:54.767151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" event={"ID":"f89f744f-dc5a-4959-b6c4-6d75c47670a1","Type":"ContainerStarted","Data":"ba1982f513b48c4111ec0e995240e81c40135b51f8e26a5ee543a9d6259dd5a0"} Jul 08 19:44:57.315988 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.315953 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp"] Jul 08 19:44:57.319600 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.319576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:44:57.324569 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.324548 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6ftqc\"" Jul 08 19:44:57.336229 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.336202 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp"] Jul 08 19:44:57.435906 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.435866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8tkv\" (UniqueName: \"kubernetes.io/projected/34ff31aa-4370-4678-a4b5-cf56d21fcfd8-kube-api-access-h8tkv\") pod \"authorino-operator-75cc8d5cb7-cdfmp\" (UID: \"34ff31aa-4370-4678-a4b5-cf56d21fcfd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:44:57.453028 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.452999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:57.537391 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.537360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8tkv\" (UniqueName: \"kubernetes.io/projected/34ff31aa-4370-4678-a4b5-cf56d21fcfd8-kube-api-access-h8tkv\") pod \"authorino-operator-75cc8d5cb7-cdfmp\" (UID: \"34ff31aa-4370-4678-a4b5-cf56d21fcfd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:44:57.554983 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.554954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8tkv\" (UniqueName: \"kubernetes.io/projected/34ff31aa-4370-4678-a4b5-cf56d21fcfd8-kube-api-access-h8tkv\") pod \"authorino-operator-75cc8d5cb7-cdfmp\" (UID: \"34ff31aa-4370-4678-a4b5-cf56d21fcfd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:44:57.632902 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.632822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:44:57.645807 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.645777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:57.788073 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:57.788050 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp"] Jul 08 19:44:57.790399 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:44:57.790371 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ff31aa_4370_4678_a4b5_cf56d21fcfd8.slice/crio-89a3b48b22cba8aef2c9270df220618025ddebc0499ad4d9bf823ba5ec8441c6 WatchSource:0}: Error finding container 89a3b48b22cba8aef2c9270df220618025ddebc0499ad4d9bf823ba5ec8441c6: Status 404 returned error can't find the container with id 89a3b48b22cba8aef2c9270df220618025ddebc0499ad4d9bf823ba5ec8441c6 Jul 08 19:44:58.406450 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:58.406416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:58.531019 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:58.530984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:58.624725 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:58.624652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:58.724940 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:58.724823 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:58.790896 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:44:58.790859 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" event={"ID":"34ff31aa-4370-4678-a4b5-cf56d21fcfd8","Type":"ContainerStarted","Data":"89a3b48b22cba8aef2c9270df220618025ddebc0499ad4d9bf823ba5ec8441c6"} Jul 08 19:45:00.262052 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:00.262017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:01.796790 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.796759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:01.806971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.806936 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" event={"ID":"f89f744f-dc5a-4959-b6c4-6d75c47670a1","Type":"ContainerStarted","Data":"99103ced5ab617965bc575a0dcdffaff304551be287f23fe6b72bfcab52cccdb"} Jul 08 19:45:01.807158 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.807000 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:01.808927 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.808901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" event={"ID":"34ff31aa-4370-4678-a4b5-cf56d21fcfd8","Type":"ContainerStarted","Data":"9a27f3e18cade0f37405f927cc1051bbcd0492fd00fb0cd06b30ccda4b7fbd1a"} Jul 08 19:45:01.809024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.808988 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:45:01.829909 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.829856 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" podStartSLOduration=1.803879646 podStartE2EDuration="8.8298406s" totalImagesPullingTime="7.025960954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:01.828154549 +0000 UTC m=+618.815958418" watchObservedRunningTime="2026-07-08 19:45:01.8298406 +0000 UTC m=+618.817644470" Jul 08 19:45:01.854611 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.854553 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" podStartSLOduration=1.697707582 podStartE2EDuration="4.854530755s" totalImagesPullingTime="3.156823173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:01.853406114 +0000 UTC m=+618.841209984" watchObservedRunningTime="2026-07-08 19:45:01.854530755 +0000 UTC m=+618.842334628" Jul 08 19:45:01.860184 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:01.860152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:02.751970 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:02.751943 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kbtcc" Jul 08 19:45:03.936432 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.936347 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-482bk"] Jul 08 19:45:03.940033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.940010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:03.942936 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.942909 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 19:45:03.943105 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.943088 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxwp2\"" Jul 08 19:45:03.943217 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.943192 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 19:45:03.959134 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.959102 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-482bk"] Jul 08 19:45:03.972214 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.972170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:03.998489 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.998460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vqcn\" (UniqueName: \"kubernetes.io/projected/82469344-79cd-416d-8fd3-74a76ebeb246-kube-api-access-6vqcn\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:03.998627 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.998498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82469344-79cd-416d-8fd3-74a76ebeb246-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:03.998627 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:03.998525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82469344-79cd-416d-8fd3-74a76ebeb246-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.068369 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.068334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:04.099557 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.099526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vqcn\" (UniqueName: \"kubernetes.io/projected/82469344-79cd-416d-8fd3-74a76ebeb246-kube-api-access-6vqcn\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.099686 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.099565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82469344-79cd-416d-8fd3-74a76ebeb246-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.099686 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.099588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82469344-79cd-416d-8fd3-74a76ebeb246-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.100268 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.100238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82469344-79cd-416d-8fd3-74a76ebeb246-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.102012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.101989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82469344-79cd-416d-8fd3-74a76ebeb246-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.110713 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.110692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vqcn\" (UniqueName: \"kubernetes.io/projected/82469344-79cd-416d-8fd3-74a76ebeb246-kube-api-access-6vqcn\") pod \"kuadrant-console-plugin-66b5774985-482bk\" (UID: \"82469344-79cd-416d-8fd3-74a76ebeb246\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.263816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.263780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" Jul 08 19:45:04.395931 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.395908 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-482bk"] Jul 08 19:45:04.398136 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:45:04.398107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82469344_79cd_416d_8fd3_74a76ebeb246.slice/crio-54c370c1043adbd871a899dd316da0652ddeedff9c1c9062c8c77a85e3feb1d3 WatchSource:0}: Error finding container 54c370c1043adbd871a899dd316da0652ddeedff9c1c9062c8c77a85e3feb1d3: Status 404 returned error can't find the container with id 54c370c1043adbd871a899dd316da0652ddeedff9c1c9062c8c77a85e3feb1d3 Jul 08 19:45:04.822604 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:04.822569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" event={"ID":"82469344-79cd-416d-8fd3-74a76ebeb246","Type":"ContainerStarted","Data":"54c370c1043adbd871a899dd316da0652ddeedff9c1c9062c8c77a85e3feb1d3"} Jul 08 19:45:05.397194 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:05.397144 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:05.459946 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:05.459912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:12.815702 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:12.815668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:12.816152 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:12.815913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cdfmp" Jul 08 19:45:14.438004 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.437969 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc"] Jul 08 19:45:14.441872 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.441846 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.479761 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.466662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc"] Jul 08 19:45:14.501700 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.501670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccj5\" (UniqueName: \"kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.501856 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.501828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.551215 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.551170 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc"] Jul 08 19:45:14.551446 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.551428 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zccj5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" Jul 08 19:45:14.602842 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.602815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.602971 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.602852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccj5\" (UniqueName: \"kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.603223 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.603205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.620576 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.620548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccj5\" (UniqueName: \"kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5\") pod \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.638539 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.638508 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc"] Jul 08 19:45:14.642873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.642851 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc"] Jul 08 19:45:14.652124 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.652099 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh"] Jul 08 19:45:14.652361 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.652333 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" containerName="manager" containerID="cri-o://99103ced5ab617965bc575a0dcdffaff304551be287f23fe6b72bfcab52cccdb" gracePeriod=2 Jul 08 19:45:14.663640 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.663583 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh"] Jul 08 19:45:14.669486 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.669445 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f89f744f-dc5a-4959-b6c4-6d75c47670a1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-z9svh\": pods \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.687582 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.687553 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:14.688101 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.688054 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" containerName="manager" Jul 08 19:45:14.688101 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.688075 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" containerName="manager" Jul 08 19:45:14.688266 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.688169 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" containerName="manager" Jul 08 19:45:14.691459 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.691435 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.707494 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.707466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:14.751728 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.751689 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.804403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.804370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.804403 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.804405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjv5d\" (UniqueName: \"kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.875470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.875437 2559 generic.go:356] "Generic (PLEG): container finished" podID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" containerID="99103ced5ab617965bc575a0dcdffaff304551be287f23fe6b72bfcab52cccdb" exitCode=0 Jul 08 19:45:14.875620 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.875531 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.878738 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.878708 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.881390 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.881361 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.882464 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.882445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.885820 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.885798 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.888348 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.888321 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.900408 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.900389 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.903050 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.903023 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z9svh\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:14.905467 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.905435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.905467 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.905475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv5d\" (UniqueName: \"kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.905680 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:14.905618 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:14.905854 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.905833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:14.916244 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:14.916220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjv5d\" (UniqueName: \"kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wqplz\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:15.006082 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zccj5\" (UniqueName: \"kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5\") pod \"1a860616-0abd-479f-bea2-e9c5e9db16cb\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " Jul 08 19:45:15.006262 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006120 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lrrf\" (UniqueName: \"kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf\") pod \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " Jul 08 19:45:15.006262 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006142 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume\") pod \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\" (UID: \"f89f744f-dc5a-4959-b6c4-6d75c47670a1\") " Jul 08 19:45:15.006262 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006221 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume\") pod \"1a860616-0abd-479f-bea2-e9c5e9db16cb\" (UID: \"1a860616-0abd-479f-bea2-e9c5e9db16cb\") " Jul 08 19:45:15.006540 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006515 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a860616-0abd-479f-bea2-e9c5e9db16cb" (UID: "1a860616-0abd-479f-bea2-e9c5e9db16cb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:15.006705 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.006683 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f89f744f-dc5a-4959-b6c4-6d75c47670a1" (UID: "f89f744f-dc5a-4959-b6c4-6d75c47670a1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:15.008330 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.008310 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5" (OuterVolumeSpecName: "kube-api-access-zccj5") pod "1a860616-0abd-479f-bea2-e9c5e9db16cb" (UID: "1a860616-0abd-479f-bea2-e9c5e9db16cb"). InnerVolumeSpecName "kube-api-access-zccj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:15.008390 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.008374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf" (OuterVolumeSpecName: "kube-api-access-7lrrf") pod "f89f744f-dc5a-4959-b6c4-6d75c47670a1" (UID: "f89f744f-dc5a-4959-b6c4-6d75c47670a1"). InnerVolumeSpecName "kube-api-access-7lrrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:15.035309 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.035289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:15.085726 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.085694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:15.107763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.107713 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zccj5\" (UniqueName: \"kubernetes.io/projected/1a860616-0abd-479f-bea2-e9c5e9db16cb-kube-api-access-zccj5\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.107763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.107750 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lrrf\" (UniqueName: \"kubernetes.io/projected/f89f744f-dc5a-4959-b6c4-6d75c47670a1-kube-api-access-7lrrf\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.107763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.107766 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f89f744f-dc5a-4959-b6c4-6d75c47670a1-extensions-socket-volume\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.107963 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.107780 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a860616-0abd-479f-bea2-e9c5e9db16cb-extensions-socket-volume\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.189468 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.189439 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:15.407527 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.407442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:15.549736 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.549699 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" path="/var/lib/kubelet/pods/1a860616-0abd-479f-bea2-e9c5e9db16cb/volumes" Jul 08 19:45:15.550115 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.550007 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89f744f-dc5a-4959-b6c4-6d75c47670a1" path="/var/lib/kubelet/pods/f89f744f-dc5a-4959-b6c4-6d75c47670a1/volumes" Jul 08 19:45:15.883162 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.883134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:15.883162 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.883153 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9svh" Jul 08 19:45:15.883414 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:15.883143 2559 scope.go:117] "RemoveContainer" containerID="99103ced5ab617965bc575a0dcdffaff304551be287f23fe6b72bfcab52cccdb" Jul 08 19:45:15.890985 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:15.890951 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:15.893655 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:15.893629 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hprkc\" is forbidden: User \"system:node:ip-10-0-131-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-119.ec2.internal' and this object" podUID="1a860616-0abd-479f-bea2-e9c5e9db16cb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hprkc" Jul 08 19:45:18.052049 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:18.052018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:18.160009 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:18.159978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:20.629161 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:20.629124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:20.736394 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:20.736360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:24.212297 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:24.212252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:24.273880 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:24.273848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:29.812485 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:45:29.812452 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3b9b93_fe2e_470f_8e67_7a8c66bc7ef5.slice/crio-9b915ad2bfe4bb83acfdb27c508be6c4e6b7c15184c0012591e43680d7f9e77f WatchSource:0}: Error finding container 9b915ad2bfe4bb83acfdb27c508be6c4e6b7c15184c0012591e43680d7f9e77f: Status 404 returned error can't find the container with id 9b915ad2bfe4bb83acfdb27c508be6c4e6b7c15184c0012591e43680d7f9e77f Jul 08 19:45:29.955521 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:29.955482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" event={"ID":"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5","Type":"ContainerStarted","Data":"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4"} Jul 08 19:45:29.955702 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:29.955542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" event={"ID":"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5","Type":"ContainerStarted","Data":"9b915ad2bfe4bb83acfdb27c508be6c4e6b7c15184c0012591e43680d7f9e77f"} Jul 08 19:45:29.955702 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:29.955596 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:29.978838 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:29.978616 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" podStartSLOduration=15.978601208 podStartE2EDuration="15.978601208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:29.977955037 +0000 UTC m=+646.965758907" watchObservedRunningTime="2026-07-08 19:45:29.978601208 +0000 UTC m=+646.966405080" Jul 08 19:45:30.963042 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:30.963004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" event={"ID":"82469344-79cd-416d-8fd3-74a76ebeb246","Type":"ContainerStarted","Data":"28cb96f010e3bea1651668a63ae285e61ce7ebd668a4fb65685f4e6875240662"} Jul 08 19:45:30.980763 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:30.980716 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-482bk" podStartSLOduration=2.174084407 podStartE2EDuration="27.980700487s" totalImagesPullingTime="25.80661608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:30.979450235 +0000 UTC m=+647.967254108" watchObservedRunningTime="2026-07-08 19:45:30.980700487 +0000 UTC m=+647.968504359" Jul 08 19:45:31.525398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:31.525363 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:31.968452 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:31.968359 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" podUID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" containerName="manager" containerID="cri-o://5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4" gracePeriod=10 Jul 08 19:45:32.283830 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.283802 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:32.471703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.471670 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume\") pod \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " Jul 08 19:45:32.471703 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.471717 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjv5d\" (UniqueName: \"kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d\") pod \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\" (UID: \"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5\") " Jul 08 19:45:32.472105 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.472079 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" (UID: "fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:32.473896 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.473873 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d" (OuterVolumeSpecName: "kube-api-access-kjv5d") pod "fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" (UID: "fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5"). InnerVolumeSpecName "kube-api-access-kjv5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:32.572506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.572470 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjv5d\" (UniqueName: \"kubernetes.io/projected/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-kube-api-access-kjv5d\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:32.572506 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.572502 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5-extensions-socket-volume\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:45:32.615826 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.615784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:32.719323 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.719286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:32.974780 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.974684 2559 generic.go:356] "Generic (PLEG): container finished" podID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" containerID="5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4" exitCode=0 Jul 08 19:45:32.974780 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.974740 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" Jul 08 19:45:32.974780 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.974762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" event={"ID":"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5","Type":"ContainerDied","Data":"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4"} Jul 08 19:45:32.975305 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.974805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz" event={"ID":"fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5","Type":"ContainerDied","Data":"9b915ad2bfe4bb83acfdb27c508be6c4e6b7c15184c0012591e43680d7f9e77f"} Jul 08 19:45:32.975305 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.974827 2559 scope.go:117] "RemoveContainer" containerID="5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4" Jul 08 19:45:32.983882 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.983861 2559 scope.go:117] "RemoveContainer" containerID="5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4" Jul 08 19:45:32.984130 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:45:32.984112 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4\": container with ID starting with 5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4 not found: ID does not exist" containerID="5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4" Jul 08 19:45:32.984217 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.984143 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4"} err="failed to get container status \"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4\": rpc error: code = NotFound desc = could not find container \"5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4\": container with ID starting with 5ea94d21d3fa4e3baa2b01b676cdb45e26a81c3290106f9706032d5051d9b5e4 not found: ID does not exist" Jul 08 19:45:32.997327 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:32.997301 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:33.007944 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:33.007919 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wqplz"] Jul 08 19:45:33.547913 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:33.547882 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" path="/var/lib/kubelet/pods/fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5/volumes" Jul 08 19:45:34.412985 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:34.412951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:34.514039 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:34.514009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:37.409106 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:37.409073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:37.511253 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:37.511224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:47.872468 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.872431 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l"] Jul 08 19:45:47.872855 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.872793 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" containerName="manager" Jul 08 19:45:47.872855 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.872805 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" containerName="manager" Jul 08 19:45:47.872927 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.872870 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd3b9b93-fe2e-470f-8e67-7a8c66bc7ef5" containerName="manager" Jul 08 19:45:47.877292 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.877272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.880093 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.880072 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-72ppz\"" Jul 08 19:45:47.880251 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.880068 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:45:47.884463 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.884438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l"] Jul 08 19:45:47.894447 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.894416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:47.907853 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.907853 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9487977f-f800-4e19-9399-dab3fabd0331-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908012 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.907986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ww5f\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-kube-api-access-5ww5f\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.908043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.908071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:47.908141 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:47.908095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9487977f-f800-4e19-9399-dab3fabd0331-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008722 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9487977f-f800-4e19-9399-dab3fabd0331-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9487977f-f800-4e19-9399-dab3fabd0331-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.008911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ww5f\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-kube-api-access-5ww5f\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009247 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009247 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.008966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.009245 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.009289 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009475 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.009413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009563 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.009534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9487977f-f800-4e19-9399-dab3fabd0331-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.009678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.009577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.011874 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.011843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9487977f-f800-4e19-9399-dab3fabd0331-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.012011 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.011989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9487977f-f800-4e19-9399-dab3fabd0331-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.017109 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.017078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.017310 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.017288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ww5f\" (UniqueName: \"kubernetes.io/projected/9487977f-f800-4e19-9399-dab3fabd0331-kube-api-access-5ww5f\") pod \"maas-default-gateway-openshift-default-56654dcf7-kjc8l\" (UID: \"9487977f-f800-4e19-9399-dab3fabd0331\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.185593 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.185503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:48.189798 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.189771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:48.331478 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:48.331451 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l"] Jul 08 19:45:48.333200 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:45:48.333152 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9487977f_f800_4e19_9399_dab3fabd0331.slice/crio-3dc5f584513ddbaa9eb0b279f906ed545cc53273434e428c282ff05532029a57 WatchSource:0}: Error finding container 3dc5f584513ddbaa9eb0b279f906ed545cc53273434e428c282ff05532029a57: Status 404 returned error can't find the container with id 3dc5f584513ddbaa9eb0b279f906ed545cc53273434e428c282ff05532029a57 Jul 08 19:45:49.048244 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:49.048212 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" event={"ID":"9487977f-f800-4e19-9399-dab3fabd0331","Type":"ContainerStarted","Data":"3dc5f584513ddbaa9eb0b279f906ed545cc53273434e428c282ff05532029a57"} Jul 08 19:45:51.632700 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:51.632658 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:45:51.633110 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:51.632771 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:45:51.633110 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:51.632820 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:45:52.066685 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:52.066645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" event={"ID":"9487977f-f800-4e19-9399-dab3fabd0331","Type":"ContainerStarted","Data":"4cc9edd3a943789f8d33ae3257f86a2ba6a7d11df83af3d7e2b849bcd29a0ea5"} Jul 08 19:45:52.087767 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:52.087705 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" podStartSLOduration=1.790823902 podStartE2EDuration="5.08768197s" totalImagesPullingTime="3.296858068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:52.087069264 +0000 UTC m=+669.074873260" watchObservedRunningTime="2026-07-08 19:45:52.08768197 +0000 UTC m=+669.075485843" Jul 08 19:45:52.190372 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:52.190332 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:52.195960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:52.195916 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:53.071581 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.071552 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:53.072589 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.072568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kjc8l" Jul 08 19:45:53.083160 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.083125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:53.083720 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.083699 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:45:53.102101 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.102066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:45:53.102311 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.102170 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.106220 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.106192 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 19:45:53.154073 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.154020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2lx\" (UniqueName: \"kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.154315 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.154155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.181306 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.181262 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:45:53.184508 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.184481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:53.239360 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.239323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:53.255517 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.255484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.255640 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.255577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2lx\" (UniqueName: \"kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.256152 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.256127 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.263908 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.263874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2lx\" (UniqueName: \"kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx\") pod \"limitador-limitador-64c94fd64f-vjfgc\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.418430 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.418329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:53.562520 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.562496 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:45:53.564969 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:45:53.564941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc249b3_6383_411f_b5be_f424a2e2fb69.slice/crio-d26fa0f4dd51c7e94d3502fa9502f679d9f24cf244618f9405eb844ed0093adc WatchSource:0}: Error finding container d26fa0f4dd51c7e94d3502fa9502f679d9f24cf244618f9405eb844ed0093adc: Status 404 returned error can't find the container with id d26fa0f4dd51c7e94d3502fa9502f679d9f24cf244618f9405eb844ed0093adc Jul 08 19:45:53.932914 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:53.932883 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:54.020328 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.020280 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:54.023899 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.023871 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:45:54.029582 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.029547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:45:54.033528 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.033494 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jkmff\"" Jul 08 19:45:54.035739 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.035708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:45:54.062169 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.062132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592bg\" (UniqueName: \"kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg\") pod \"authorino-75d556bd77-t5jlv\" (UID: \"3b9b93bf-b727-42ad-8742-c2978632ec60\") " pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:45:54.077130 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.077091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" event={"ID":"8fc249b3-6383-411f-b5be-f424a2e2fb69","Type":"ContainerStarted","Data":"d26fa0f4dd51c7e94d3502fa9502f679d9f24cf244618f9405eb844ed0093adc"} Jul 08 19:45:54.163378 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.163340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592bg\" (UniqueName: \"kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg\") pod \"authorino-75d556bd77-t5jlv\" (UID: \"3b9b93bf-b727-42ad-8742-c2978632ec60\") " pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:45:54.172404 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.172371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592bg\" (UniqueName: \"kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg\") pod \"authorino-75d556bd77-t5jlv\" (UID: \"3b9b93bf-b727-42ad-8742-c2978632ec60\") " pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:45:54.341121 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.341073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:45:54.525898 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:54.524972 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:45:54.530091 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:45:54.530055 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b9b93bf_b727_42ad_8742_c2978632ec60.slice/crio-418840973b511ca14023043b911ec4573184f259fcda69197d50d672ef6146d2 WatchSource:0}: Error finding container 418840973b511ca14023043b911ec4573184f259fcda69197d50d672ef6146d2: Status 404 returned error can't find the container with id 418840973b511ca14023043b911ec4573184f259fcda69197d50d672ef6146d2 Jul 08 19:45:55.085929 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:55.085806 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t5jlv" event={"ID":"3b9b93bf-b727-42ad-8742-c2978632ec60","Type":"ContainerStarted","Data":"418840973b511ca14023043b911ec4573184f259fcda69197d50d672ef6146d2"} Jul 08 19:45:59.111928 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:59.111887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t5jlv" event={"ID":"3b9b93bf-b727-42ad-8742-c2978632ec60","Type":"ContainerStarted","Data":"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991"} Jul 08 19:45:59.113606 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:59.113573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" event={"ID":"8fc249b3-6383-411f-b5be-f424a2e2fb69","Type":"ContainerStarted","Data":"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51"} Jul 08 19:45:59.113744 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:59.113706 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:45:59.130857 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:59.130802 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-t5jlv" podStartSLOduration=1.282528899 podStartE2EDuration="5.130783803s" totalImagesPullingTime="3.848254904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:59.130206269 +0000 UTC m=+676.118010141" watchObservedRunningTime="2026-07-08 19:45:59.130783803 +0000 UTC m=+676.118587675" Jul 08 19:45:59.156307 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:45:59.147126 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" podStartSLOduration=1.346370687 podStartE2EDuration="6.147098289s" totalImagesPullingTime="4.800727602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:59.146613869 +0000 UTC m=+676.134417742" watchObservedRunningTime="2026-07-08 19:45:59.147098289 +0000 UTC m=+676.134902161" Jul 08 19:46:03.210782 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:03.210742 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:03.265126 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:03.265089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:09.578025 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:09.577987 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:46:09.578547 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:09.578208 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" podUID="8fc249b3-6383-411f-b5be-f424a2e2fb69" containerName="limitador" containerID="cri-o://a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51" gracePeriod=30 Jul 08 19:46:09.578854 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:09.578833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:46:10.122974 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.122949 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:46:10.166667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.166590 2559 generic.go:356] "Generic (PLEG): container finished" podID="8fc249b3-6383-411f-b5be-f424a2e2fb69" containerID="a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51" exitCode=0 Jul 08 19:46:10.166667 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.166631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" event={"ID":"8fc249b3-6383-411f-b5be-f424a2e2fb69","Type":"ContainerDied","Data":"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51"} Jul 08 19:46:10.166854 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.166687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" event={"ID":"8fc249b3-6383-411f-b5be-f424a2e2fb69","Type":"ContainerDied","Data":"d26fa0f4dd51c7e94d3502fa9502f679d9f24cf244618f9405eb844ed0093adc"} Jul 08 19:46:10.166854 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.166711 2559 scope.go:117] "RemoveContainer" containerID="a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51" Jul 08 19:46:10.166854 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.166645 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vjfgc" Jul 08 19:46:10.175266 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.175247 2559 scope.go:117] "RemoveContainer" containerID="a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51" Jul 08 19:46:10.175546 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:46:10.175523 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51\": container with ID starting with a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51 not found: ID does not exist" containerID="a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51" Jul 08 19:46:10.175596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.175560 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51"} err="failed to get container status \"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51\": rpc error: code = NotFound desc = could not find container \"a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51\": container with ID starting with a6f145f4ad8ab4aa75456893ff92b23e5368288534910ea851655f34928c2e51 not found: ID does not exist" Jul 08 19:46:10.208072 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.208041 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm2lx\" (UniqueName: \"kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx\") pod \"8fc249b3-6383-411f-b5be-f424a2e2fb69\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " Jul 08 19:46:10.208248 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.208109 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file\") pod \"8fc249b3-6383-411f-b5be-f424a2e2fb69\" (UID: \"8fc249b3-6383-411f-b5be-f424a2e2fb69\") " Jul 08 19:46:10.208480 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.208456 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file" (OuterVolumeSpecName: "config-file") pod "8fc249b3-6383-411f-b5be-f424a2e2fb69" (UID: "8fc249b3-6383-411f-b5be-f424a2e2fb69"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:46:10.210367 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.210347 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx" (OuterVolumeSpecName: "kube-api-access-nm2lx") pod "8fc249b3-6383-411f-b5be-f424a2e2fb69" (UID: "8fc249b3-6383-411f-b5be-f424a2e2fb69"). InnerVolumeSpecName "kube-api-access-nm2lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:46:10.308816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.308774 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm2lx\" (UniqueName: \"kubernetes.io/projected/8fc249b3-6383-411f-b5be-f424a2e2fb69-kube-api-access-nm2lx\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:46:10.308816 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.308809 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8fc249b3-6383-411f-b5be-f424a2e2fb69-config-file\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:46:10.488082 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.488053 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:46:10.494125 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:10.494099 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vjfgc"] Jul 08 19:46:11.547370 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:11.547339 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc249b3-6383-411f-b5be-f424a2e2fb69" path="/var/lib/kubelet/pods/8fc249b3-6383-411f-b5be-f424a2e2fb69/volumes" Jul 08 19:46:14.378722 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.378676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:14.470030 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.469998 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:14.840462 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.840432 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qh72"] Jul 08 19:46:14.840982 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.840967 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc249b3-6383-411f-b5be-f424a2e2fb69" containerName="limitador" Jul 08 19:46:14.841029 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.840986 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc249b3-6383-411f-b5be-f424a2e2fb69" containerName="limitador" Jul 08 19:46:14.841106 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.841094 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc249b3-6383-411f-b5be-f424a2e2fb69" containerName="limitador" Jul 08 19:46:14.845578 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.845560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:14.848813 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.848784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 19:46:14.848937 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.848822 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:46:14.848937 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.848835 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:46:14.850609 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.850590 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rqvtw\"" Jul 08 19:46:14.853264 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.853240 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qh72"] Jul 08 19:46:14.872442 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.872419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:14.952460 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.952436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87715ddb-b617-4f03-8589-8685279a6bbb-data\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:14.952628 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:14.952528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxb6c\" (UniqueName: \"kubernetes.io/projected/87715ddb-b617-4f03-8589-8685279a6bbb-kube-api-access-fxb6c\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.053925 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.053896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87715ddb-b617-4f03-8589-8685279a6bbb-data\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.054059 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.053973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxb6c\" (UniqueName: \"kubernetes.io/projected/87715ddb-b617-4f03-8589-8685279a6bbb-kube-api-access-fxb6c\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.054367 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.054344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/87715ddb-b617-4f03-8589-8685279a6bbb-data\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.065859 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.065839 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxb6c\" (UniqueName: \"kubernetes.io/projected/87715ddb-b617-4f03-8589-8685279a6bbb-kube-api-access-fxb6c\") pod \"postgres-69fb4594cf-2qh72\" (UID: \"87715ddb-b617-4f03-8589-8685279a6bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.157031 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.156948 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:15.297842 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.297813 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2qh72"] Jul 08 19:46:15.300000 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:46:15.299974 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87715ddb_b617_4f03_8589_8685279a6bbb.slice/crio-b997bcd7080363cfef40e2f7f6808a578d2f5910c496c0b7e1d052f557bbf39f WatchSource:0}: Error finding container b997bcd7080363cfef40e2f7f6808a578d2f5910c496c0b7e1d052f557bbf39f: Status 404 returned error can't find the container with id b997bcd7080363cfef40e2f7f6808a578d2f5910c496c0b7e1d052f557bbf39f Jul 08 19:46:15.301271 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:15.301246 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:46:16.199557 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:16.199472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" event={"ID":"87715ddb-b617-4f03-8589-8685279a6bbb","Type":"ContainerStarted","Data":"b997bcd7080363cfef40e2f7f6808a578d2f5910c496c0b7e1d052f557bbf39f"} Jul 08 19:46:20.223907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:20.223815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" event={"ID":"87715ddb-b617-4f03-8589-8685279a6bbb","Type":"ContainerStarted","Data":"409fe8890e0901f563fdea654abcbecce5e652a398d4464e6bfcaffc0fc56669"} Jul 08 19:46:20.224351 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:20.223922 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:20.241958 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:20.241912 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" podStartSLOduration=1.585108243 podStartE2EDuration="6.241900426s" totalImagesPullingTime="4.656792183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:46:20.240093734 +0000 UTC m=+697.227897605" watchObservedRunningTime="2026-07-08 19:46:20.241900426 +0000 UTC m=+697.229704297" Jul 08 19:46:26.259276 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.259235 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2qh72" Jul 08 19:46:26.587470 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.587386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:26.824421 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.824387 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:26.827568 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.827551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:26.834866 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.834840 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:26.865577 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.865493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wrk\" (UniqueName: \"kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk\") pod \"authorino-5d4b67c446-69rzg\" (UID: \"24595d30-89e7-4880-a791-242969c24642\") " pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:26.966680 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.966643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wrk\" (UniqueName: \"kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk\") pod \"authorino-5d4b67c446-69rzg\" (UID: \"24595d30-89e7-4880-a791-242969c24642\") " pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:26.975578 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:26.975547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wrk\" (UniqueName: \"kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk\") pod \"authorino-5d4b67c446-69rzg\" (UID: \"24595d30-89e7-4880-a791-242969c24642\") " pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:27.119326 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.119245 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:27.119553 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.119539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:27.153056 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.153022 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:27.157771 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.157746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:27.163672 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.163634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:27.168346 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.168317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xlg\" (UniqueName: \"kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg\") pod \"authorino-68876dc567-7khb4\" (UID: \"6b83a3f8-fe54-4cdb-9851-30f6040423ec\") " pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:27.201208 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.201160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:27.258399 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.258377 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:27.260638 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:46:27.260609 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24595d30_89e7_4880_a791_242969c24642.slice/crio-a2117e3dad3e05e63e93ba6c77b4c4dbf5bd494e54874a54a9661b6dee1d9f95 WatchSource:0}: Error finding container a2117e3dad3e05e63e93ba6c77b4c4dbf5bd494e54874a54a9661b6dee1d9f95: Status 404 returned error can't find the container with id a2117e3dad3e05e63e93ba6c77b4c4dbf5bd494e54874a54a9661b6dee1d9f95 Jul 08 19:46:27.268805 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.268777 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xlg\" (UniqueName: \"kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg\") pod \"authorino-68876dc567-7khb4\" (UID: \"6b83a3f8-fe54-4cdb-9851-30f6040423ec\") " pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:27.277244 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.277206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xlg\" (UniqueName: \"kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg\") pod \"authorino-68876dc567-7khb4\" (UID: \"6b83a3f8-fe54-4cdb-9851-30f6040423ec\") " pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:27.385833 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.385754 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:27.386008 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.385996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:27.413678 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.413650 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8f994d55-7nl2s"] Jul 08 19:46:27.417581 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.417559 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.420096 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.420074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 19:46:27.426650 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.425205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8f994d55-7nl2s"] Jul 08 19:46:27.470190 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.470132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-tls-cert\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.470354 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.470217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl5h5\" (UniqueName: \"kubernetes.io/projected/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-kube-api-access-hl5h5\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.522067 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.522043 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:27.523956 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:46:27.523933 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b83a3f8_fe54_4cdb_9851_30f6040423ec.slice/crio-5b62379357bcd8301627e6132a2bbadb428a2cabbe9210d5bd57e793814dc3aa WatchSource:0}: Error finding container 5b62379357bcd8301627e6132a2bbadb428a2cabbe9210d5bd57e793814dc3aa: Status 404 returned error can't find the container with id 5b62379357bcd8301627e6132a2bbadb428a2cabbe9210d5bd57e793814dc3aa Jul 08 19:46:27.571395 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.571356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-tls-cert\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.571560 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.571425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl5h5\" (UniqueName: \"kubernetes.io/projected/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-kube-api-access-hl5h5\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.574016 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.573989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-tls-cert\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.579575 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.579559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl5h5\" (UniqueName: \"kubernetes.io/projected/ffe4e28a-bebf-45ba-ba90-d979a0d47d47-kube-api-access-hl5h5\") pod \"authorino-8f994d55-7nl2s\" (UID: \"ffe4e28a-bebf-45ba-ba90-d979a0d47d47\") " pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.729388 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.729367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8f994d55-7nl2s" Jul 08 19:46:27.872955 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:27.872847 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8f994d55-7nl2s"] Jul 08 19:46:27.875857 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:46:27.875833 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffe4e28a_bebf_45ba_ba90_d979a0d47d47.slice/crio-59d42fda5b68f7be7945a44b0e518ef9cf4ff6065459f281d8995885b0c112fc WatchSource:0}: Error finding container 59d42fda5b68f7be7945a44b0e518ef9cf4ff6065459f281d8995885b0c112fc: Status 404 returned error can't find the container with id 59d42fda5b68f7be7945a44b0e518ef9cf4ff6065459f281d8995885b0c112fc Jul 08 19:46:28.270381 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.270340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8f994d55-7nl2s" event={"ID":"ffe4e28a-bebf-45ba-ba90-d979a0d47d47","Type":"ContainerStarted","Data":"59d42fda5b68f7be7945a44b0e518ef9cf4ff6065459f281d8995885b0c112fc"} Jul 08 19:46:28.272033 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.272008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-69rzg" event={"ID":"24595d30-89e7-4880-a791-242969c24642","Type":"ContainerStarted","Data":"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9"} Jul 08 19:46:28.272161 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.272047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-69rzg" event={"ID":"24595d30-89e7-4880-a791-242969c24642","Type":"ContainerStarted","Data":"a2117e3dad3e05e63e93ba6c77b4c4dbf5bd494e54874a54a9661b6dee1d9f95"} Jul 08 19:46:28.272161 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.272088 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-69rzg" podUID="24595d30-89e7-4880-a791-242969c24642" containerName="authorino" containerID="cri-o://140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9" gracePeriod=30 Jul 08 19:46:28.273759 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.273734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68876dc567-7khb4" event={"ID":"6b83a3f8-fe54-4cdb-9851-30f6040423ec","Type":"ContainerStarted","Data":"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870"} Jul 08 19:46:28.273879 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.273774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68876dc567-7khb4" event={"ID":"6b83a3f8-fe54-4cdb-9851-30f6040423ec","Type":"ContainerStarted","Data":"5b62379357bcd8301627e6132a2bbadb428a2cabbe9210d5bd57e793814dc3aa"} Jul 08 19:46:28.273879 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.273856 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68876dc567-7khb4" podUID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" containerName="authorino" containerID="cri-o://4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870" gracePeriod=30 Jul 08 19:46:28.289055 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.289017 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-69rzg" podStartSLOduration=1.8265676050000001 podStartE2EDuration="2.289003527s" totalImagesPullingTime="462.435922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:46:28.287125863 +0000 UTC m=+705.274929735" watchObservedRunningTime="2026-07-08 19:46:28.289003527 +0000 UTC m=+705.276807398" Jul 08 19:46:28.303732 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.303694 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68876dc567-7khb4" podStartSLOduration=0.700145093 podStartE2EDuration="1.30367868s" totalImagesPullingTime="603.533587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:46:28.302507766 +0000 UTC m=+705.290311639" watchObservedRunningTime="2026-07-08 19:46:28.30367868 +0000 UTC m=+705.291482554" Jul 08 19:46:28.582751 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.582719 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:28.608832 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.608802 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:28.680618 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.680519 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9xlg\" (UniqueName: \"kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg\") pod \"6b83a3f8-fe54-4cdb-9851-30f6040423ec\" (UID: \"6b83a3f8-fe54-4cdb-9851-30f6040423ec\") " Jul 08 19:46:28.680618 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.680588 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4wrk\" (UniqueName: \"kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk\") pod \"24595d30-89e7-4880-a791-242969c24642\" (UID: \"24595d30-89e7-4880-a791-242969c24642\") " Jul 08 19:46:28.683280 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.683216 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg" (OuterVolumeSpecName: "kube-api-access-r9xlg") pod "6b83a3f8-fe54-4cdb-9851-30f6040423ec" (UID: "6b83a3f8-fe54-4cdb-9851-30f6040423ec"). InnerVolumeSpecName "kube-api-access-r9xlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:46:28.683502 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.683474 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk" (OuterVolumeSpecName: "kube-api-access-d4wrk") pod "24595d30-89e7-4880-a791-242969c24642" (UID: "24595d30-89e7-4880-a791-242969c24642"). InnerVolumeSpecName "kube-api-access-d4wrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:46:28.781095 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.781061 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4wrk\" (UniqueName: \"kubernetes.io/projected/24595d30-89e7-4880-a791-242969c24642-kube-api-access-d4wrk\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:46:28.781095 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:28.781087 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9xlg\" (UniqueName: \"kubernetes.io/projected/6b83a3f8-fe54-4cdb-9851-30f6040423ec-kube-api-access-r9xlg\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:46:29.279799 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.279761 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8f994d55-7nl2s" event={"ID":"ffe4e28a-bebf-45ba-ba90-d979a0d47d47","Type":"ContainerStarted","Data":"d536d22ec18cee21429b1b1fecee230d8dade1a5f31a8241b0dae3bccddbe903"} Jul 08 19:46:29.281058 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.281032 2559 generic.go:356] "Generic (PLEG): container finished" podID="24595d30-89e7-4880-a791-242969c24642" containerID="140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9" exitCode=0 Jul 08 19:46:29.281201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.281087 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-69rzg" Jul 08 19:46:29.281201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.281111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-69rzg" event={"ID":"24595d30-89e7-4880-a791-242969c24642","Type":"ContainerDied","Data":"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9"} Jul 08 19:46:29.281201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.281146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-69rzg" event={"ID":"24595d30-89e7-4880-a791-242969c24642","Type":"ContainerDied","Data":"a2117e3dad3e05e63e93ba6c77b4c4dbf5bd494e54874a54a9661b6dee1d9f95"} Jul 08 19:46:29.281201 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.281168 2559 scope.go:117] "RemoveContainer" containerID="140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9" Jul 08 19:46:29.282373 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.282311 2559 generic.go:356] "Generic (PLEG): container finished" podID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" containerID="4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870" exitCode=0 Jul 08 19:46:29.282373 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.282368 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68876dc567-7khb4" Jul 08 19:46:29.282483 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.282389 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68876dc567-7khb4" event={"ID":"6b83a3f8-fe54-4cdb-9851-30f6040423ec","Type":"ContainerDied","Data":"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870"} Jul 08 19:46:29.282483 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.282416 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68876dc567-7khb4" event={"ID":"6b83a3f8-fe54-4cdb-9851-30f6040423ec","Type":"ContainerDied","Data":"5b62379357bcd8301627e6132a2bbadb428a2cabbe9210d5bd57e793814dc3aa"} Jul 08 19:46:29.290059 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.289838 2559 scope.go:117] "RemoveContainer" containerID="140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9" Jul 08 19:46:29.290192 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:46:29.290147 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9\": container with ID starting with 140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9 not found: ID does not exist" containerID="140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9" Jul 08 19:46:29.290268 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.290203 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9"} err="failed to get container status \"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9\": rpc error: code = NotFound desc = could not find container \"140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9\": container with ID starting with 140dbe851eaee9eaa28097868061995d4b9cfa63d1da588f8515e4e9cd62c3e9 not found: ID does not exist" Jul 08 19:46:29.290268 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.290225 2559 scope.go:117] "RemoveContainer" containerID="4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870" Jul 08 19:46:29.296437 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.296398 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8f994d55-7nl2s" podStartSLOduration=1.671354528 podStartE2EDuration="2.296382156s" totalImagesPullingTime="625.027628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:46:29.294580256 +0000 UTC m=+706.282384153" watchObservedRunningTime="2026-07-08 19:46:29.296382156 +0000 UTC m=+706.284186027" Jul 08 19:46:29.298842 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.298822 2559 scope.go:117] "RemoveContainer" containerID="4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870" Jul 08 19:46:29.299102 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:46:29.299083 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870\": container with ID starting with 4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870 not found: ID does not exist" containerID="4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870" Jul 08 19:46:29.299169 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.299118 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870"} err="failed to get container status \"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870\": rpc error: code = NotFound desc = could not find container \"4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870\": container with ID starting with 4960d6486e39b0b4bca1ef551b93ef9d85314a77e5cab519e38263492bba2870 not found: ID does not exist" Jul 08 19:46:29.312125 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.312101 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:29.315314 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.315295 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-69rzg"] Jul 08 19:46:29.324930 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.324900 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:46:29.325088 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.325069 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-t5jlv" podUID="3b9b93bf-b727-42ad-8742-c2978632ec60" containerName="authorino" containerID="cri-o://4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991" gracePeriod=30 Jul 08 19:46:29.328009 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.327983 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:29.335014 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.334992 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68876dc567-7khb4"] Jul 08 19:46:29.549970 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.549878 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24595d30-89e7-4880-a791-242969c24642" path="/var/lib/kubelet/pods/24595d30-89e7-4880-a791-242969c24642/volumes" Jul 08 19:46:29.550394 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.550377 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" path="/var/lib/kubelet/pods/6b83a3f8-fe54-4cdb-9851-30f6040423ec/volumes" Jul 08 19:46:29.624865 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.624839 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:46:29.694916 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.694884 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592bg\" (UniqueName: \"kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg\") pod \"3b9b93bf-b727-42ad-8742-c2978632ec60\" (UID: \"3b9b93bf-b727-42ad-8742-c2978632ec60\") " Jul 08 19:46:29.697093 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.697068 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg" (OuterVolumeSpecName: "kube-api-access-592bg") pod "3b9b93bf-b727-42ad-8742-c2978632ec60" (UID: "3b9b93bf-b727-42ad-8742-c2978632ec60"). InnerVolumeSpecName "kube-api-access-592bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:46:29.795688 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:29.795654 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592bg\" (UniqueName: \"kubernetes.io/projected/3b9b93bf-b727-42ad-8742-c2978632ec60-kube-api-access-592bg\") on node \"ip-10-0-131-119.ec2.internal\" DevicePath \"\"" Jul 08 19:46:30.288398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.288365 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b9b93bf-b727-42ad-8742-c2978632ec60" containerID="4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991" exitCode=0 Jul 08 19:46:30.288921 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.288410 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t5jlv" Jul 08 19:46:30.288921 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.288447 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t5jlv" event={"ID":"3b9b93bf-b727-42ad-8742-c2978632ec60","Type":"ContainerDied","Data":"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991"} Jul 08 19:46:30.288921 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.288486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t5jlv" event={"ID":"3b9b93bf-b727-42ad-8742-c2978632ec60","Type":"ContainerDied","Data":"418840973b511ca14023043b911ec4573184f259fcda69197d50d672ef6146d2"} Jul 08 19:46:30.288921 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.288580 2559 scope.go:117] "RemoveContainer" containerID="4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991" Jul 08 19:46:30.297592 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.297576 2559 scope.go:117] "RemoveContainer" containerID="4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991" Jul 08 19:46:30.297826 ip-10-0-131-119 kubenswrapper[2559]: E0708 19:46:30.297809 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991\": container with ID starting with 4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991 not found: ID does not exist" containerID="4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991" Jul 08 19:46:30.297877 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.297835 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991"} err="failed to get container status \"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991\": rpc error: code = NotFound desc = could not find container \"4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991\": container with ID starting with 4972ee88768a1131290e55b15aa88846cf945aaf0e3de2b642bd081025dd5991 not found: ID does not exist" Jul 08 19:46:30.309789 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.309766 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:46:30.314817 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:30.314797 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t5jlv"] Jul 08 19:46:31.548166 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:31.548132 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9b93bf-b727-42ad-8742-c2978632ec60" path="/var/lib/kubelet/pods/3b9b93bf-b727-42ad-8742-c2978632ec60/volumes" Jul 08 19:46:33.596626 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:33.596598 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8f994d55-7nl2s_ffe4e28a-bebf-45ba-ba90-d979a0d47d47/authorino/0.log" Jul 08 19:46:37.703759 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:37.703730 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-8c7vd_876ba3a7-eb2c-4326-a942-e0f75d0bf06c/copy-manifests/0.log" Jul 08 19:46:37.711295 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:37.711274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-8c7vd_876ba3a7-eb2c-4326-a942-e0f75d0bf06c/manager/0.log" Jul 08 19:46:39.065225 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:39.065164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8f994d55-7nl2s_ffe4e28a-bebf-45ba-ba90-d979a0d47d47/authorino/0.log" Jul 08 19:46:39.181415 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:39.181387 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdfmp_34ff31aa-4370-4678-a4b5-cf56d21fcfd8/manager/0.log" Jul 08 19:46:39.296165 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:39.296134 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kbtcc_e329b9b0-7b9c-4870-84fa-fba2093ceb25/manager/0.log" Jul 08 19:46:39.405911 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:39.405830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-482bk_82469344-79cd-416d-8fd3-74a76ebeb246/kuadrant-console-plugin/0.log" Jul 08 19:46:39.524542 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:39.524516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c6gc5_5bf2e691-cac8-4a67-bcc4-b8af0f7c7068/registry-server/0.log" Jul 08 19:46:40.685742 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:40.685696 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjc8l_9487977f-f800-4e19-9399-dab3fabd0331/istio-proxy/0.log" Jul 08 19:46:40.797963 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:40.797937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bcdc55579-xpxfj_ffb6e633-7590-4ffa-8891-b53297bcc0a6/router/0.log" Jul 08 19:46:44.949674 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:44.949643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:45.048668 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:45.048636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" limit=1024 Jul 08 19:46:48.048536 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:48.048504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-755zf_e575239b-2bc0-4d4b-bca5-cea88e401d80/global-pull-secret-syncer/0.log" Jul 08 19:46:48.136698 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:48.136670 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mjphv_99a02fe3-c467-4503-9cdd-05aa38c92b38/konnectivity-agent/0.log" Jul 08 19:46:48.214019 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:48.213978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-119.ec2.internal_9a0bc436887006b5401efbd37faaf404/haproxy/0.log" Jul 08 19:46:52.048938 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:52.048908 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8f994d55-7nl2s_ffe4e28a-bebf-45ba-ba90-d979a0d47d47/authorino/0.log" Jul 08 19:46:52.081002 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:52.080973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cdfmp_34ff31aa-4370-4678-a4b5-cf56d21fcfd8/manager/0.log" Jul 08 19:46:52.129730 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:52.129707 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kbtcc_e329b9b0-7b9c-4870-84fa-fba2093ceb25/manager/0.log" Jul 08 19:46:52.161587 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:52.161558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-482bk_82469344-79cd-416d-8fd3-74a76ebeb246/kuadrant-console-plugin/0.log" Jul 08 19:46:52.216457 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:52.216373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c6gc5_5bf2e691-cac8-4a67-bcc4-b8af0f7c7068/registry-server/0.log" Jul 08 19:46:54.195121 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.195078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-c8s4q_fdad0506-1bc8-4076-9519-546cc4283fe7/cluster-monitoring-operator/0.log" Jul 08 19:46:54.329242 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.329144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-pmbhd_9b22cbac-27ba-4d75-b853-19239da6c3a6/monitoring-plugin/0.log" Jul 08 19:46:54.360815 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.360783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/node-exporter/0.log" Jul 08 19:46:54.382788 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.382758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/kube-rbac-proxy/0.log" Jul 08 19:46:54.405799 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.405776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f94kf_9a0f827b-53a2-43a4-8d4b-ed6b79359360/init-textfile/0.log" Jul 08 19:46:54.588533 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.588455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/kube-rbac-proxy-main/0.log" Jul 08 19:46:54.610226 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.610205 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/kube-rbac-proxy-self/0.log" Jul 08 19:46:54.631372 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.631351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q54bq_92250f1f-2211-4b1d-9e69-529e8e9f862f/openshift-state-metrics/0.log" Jul 08 19:46:54.670574 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.670555 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/prometheus/0.log" Jul 08 19:46:54.690429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.690377 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/config-reloader/0.log" Jul 08 19:46:54.714509 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.714478 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/thanos-sidecar/0.log" Jul 08 19:46:54.735310 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.735281 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/kube-rbac-proxy-web/0.log" Jul 08 19:46:54.761830 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.761808 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/kube-rbac-proxy/0.log" Jul 08 19:46:54.786500 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.786479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/kube-rbac-proxy-thanos/0.log" Jul 08 19:46:54.811007 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:54.810991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb07ed2b-72d5-476b-b2b8-69c6a1af765a/init-config-reloader/0.log" Jul 08 19:46:55.068429 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.068396 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/thanos-query/0.log" Jul 08 19:46:55.112098 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.112075 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-web/0.log" Jul 08 19:46:55.152869 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.152847 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy/0.log" Jul 08 19:46:55.175187 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.175144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/prom-label-proxy/0.log" Jul 08 19:46:55.196234 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.196210 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-rules/0.log" Jul 08 19:46:55.218985 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:55.218962 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8654ff7678-b7t42_a7d5e134-66f2-436d-93c7-ecf2bd1ea11a/kube-rbac-proxy-metrics/0.log" Jul 08 19:46:58.535548 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535517 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp"] Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535897 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24595d30-89e7-4880-a791-242969c24642" containerName="authorino" Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535908 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24595d30-89e7-4880-a791-242969c24642" containerName="authorino" Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535916 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9b93bf-b727-42ad-8742-c2978632ec60" containerName="authorino" Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535921 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9b93bf-b727-42ad-8742-c2978632ec60" containerName="authorino" Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535938 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" containerName="authorino" Jul 08 19:46:58.535960 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.535944 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" containerName="authorino" Jul 08 19:46:58.536155 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.536018 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9b93bf-b727-42ad-8742-c2978632ec60" containerName="authorino" Jul 08 19:46:58.536155 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.536025 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24595d30-89e7-4880-a791-242969c24642" containerName="authorino" Jul 08 19:46:58.536155 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.536031 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b83a3f8-fe54-4cdb-9851-30f6040423ec" containerName="authorino" Jul 08 19:46:58.552937 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.552911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp"] Jul 08 19:46:58.553117 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.553001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.555889 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.555868 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzvtk\"/\"openshift-service-ca.crt\"" Jul 08 19:46:58.556066 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.555928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzvtk\"/\"kube-root-ca.crt\"" Jul 08 19:46:58.557409 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.557391 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pzvtk\"/\"default-dockercfg-z6p5z\"" Jul 08 19:46:58.619790 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.619760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-5ltj7_62b6fe70-e8ef-48ab-bc49-4d41db755481/volume-data-source-validator/0.log" Jul 08 19:46:58.654541 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.654512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-podres\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.654712 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.654553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-lib-modules\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.654712 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.654619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-proc\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.654712 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.654634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnpqv\" (UniqueName: \"kubernetes.io/projected/ea81fde0-e965-41aa-a88a-c74462449900-kube-api-access-cnpqv\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.654871 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.654735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-sys\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.755935 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.755891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-proc\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.755935 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.755934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnpqv\" (UniqueName: \"kubernetes.io/projected/ea81fde0-e965-41aa-a88a-c74462449900-kube-api-access-cnpqv\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.755971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-sys\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-podres\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-lib-modules\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-proc\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756156 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-sys\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-podres\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.756364 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.756215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea81fde0-e965-41aa-a88a-c74462449900-lib-modules\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.764226 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.764201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnpqv\" (UniqueName: \"kubernetes.io/projected/ea81fde0-e965-41aa-a88a-c74462449900-kube-api-access-cnpqv\") pod \"perf-node-gather-daemonset-pztwp\" (UID: \"ea81fde0-e965-41aa-a88a-c74462449900\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:58.864123 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:58.864024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:59.004518 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.004484 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp"] Jul 08 19:46:59.007850 ip-10-0-131-119 kubenswrapper[2559]: W0708 19:46:59.007821 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea81fde0_e965_41aa_a88a_c74462449900.slice/crio-78f5521582a70e229a8582cd824450621b29d9530b39e69db1f13f4ce492e61f WatchSource:0}: Error finding container 78f5521582a70e229a8582cd824450621b29d9530b39e69db1f13f4ce492e61f: Status 404 returned error can't find the container with id 78f5521582a70e229a8582cd824450621b29d9530b39e69db1f13f4ce492e61f Jul 08 19:46:59.427151 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.427115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" event={"ID":"ea81fde0-e965-41aa-a88a-c74462449900","Type":"ContainerStarted","Data":"291941dc2454be41cbb33929e3317a6070dee574c507cfc4eea82215df8f5d9b"} Jul 08 19:46:59.427361 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.427201 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" event={"ID":"ea81fde0-e965-41aa-a88a-c74462449900","Type":"ContainerStarted","Data":"78f5521582a70e229a8582cd824450621b29d9530b39e69db1f13f4ce492e61f"} Jul 08 19:46:59.427361 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.427235 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:46:59.447111 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.447054 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" podStartSLOduration=1.447038765 podStartE2EDuration="1.447038765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:46:59.446356025 +0000 UTC m=+736.434159896" watchObservedRunningTime="2026-07-08 19:46:59.447038765 +0000 UTC m=+736.434842636" Jul 08 19:46:59.730730 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.730632 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82fkw_6cba8a16-6b11-4417-8476-92eb6b69903b/dns/0.log" Jul 08 19:46:59.752222 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.752169 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82fkw_6cba8a16-6b11-4417-8476-92eb6b69903b/kube-rbac-proxy/0.log" Jul 08 19:46:59.848596 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:46:59.848564 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pn57x_44a97c13-4c66-40f6-b7fc-0898c34e0e6d/dns-node-resolver/0.log" Jul 08 19:47:00.402549 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:00.402519 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64bfbbd747-vjdkl_911632c7-76ff-4ec3-853a-9454bc865953/registry/0.log" Jul 08 19:47:00.425475 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:00.425451 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-57sf7_4939a718-e97c-4533-8ff3-90eb5cc09726/node-ca/0.log" Jul 08 19:47:01.541524 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:01.541499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjc8l_9487977f-f800-4e19-9399-dab3fabd0331/istio-proxy/0.log" Jul 08 19:47:01.575627 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:01.575600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bcdc55579-xpxfj_ffb6e633-7590-4ffa-8891-b53297bcc0a6/router/0.log" Jul 08 19:47:02.158821 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:02.158792 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gld2j_4a040575-7104-450c-b6f8-2505a0bd3cd1/serve-healthcheck-canary/0.log" Jul 08 19:47:02.697326 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:02.697298 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7zrrh_865477e2-e834-40c2-9ca0-a85032a7b333/kube-rbac-proxy/0.log" Jul 08 19:47:02.718647 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:02.718620 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7zrrh_865477e2-e834-40c2-9ca0-a85032a7b333/exporter/0.log" Jul 08 19:47:02.740194 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:02.740149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7zrrh_865477e2-e834-40c2-9ca0-a85032a7b333/extractor/0.log" Jul 08 19:47:05.179138 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:05.179102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-8c7vd_876ba3a7-eb2c-4326-a942-e0f75d0bf06c/manager/0.log" Jul 08 19:47:05.199198 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:05.199162 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-8c7vd_876ba3a7-eb2c-4326-a942-e0f75d0bf06c/copy-manifests/0.log" Jul 08 19:47:05.442548 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:05.442465 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-pztwp" Jul 08 19:47:06.368077 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:06.368045 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bd7c86d9-z546r_65dc98e4-82dc-494b-bd21-3f2b5a8ec0f1/manager/0.log" Jul 08 19:47:08.364024 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:08.364000 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjc8l_9487977f-f800-4e19-9399-dab3fabd0331/istio-proxy/0.log" Jul 08 19:47:08.384602 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:08.384574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bcdc55579-xpxfj_ffb6e633-7590-4ffa-8891-b53297bcc0a6/router/0.log" Jul 08 19:47:09.547733 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:09.547701 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kjc8l_9487977f-f800-4e19-9399-dab3fabd0331/istio-proxy/0.log" Jul 08 19:47:09.565126 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:09.565102 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bcdc55579-xpxfj_ffb6e633-7590-4ffa-8891-b53297bcc0a6/router/0.log" Jul 08 19:47:11.616919 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:11.616890 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6hm69_c8f6e680-647d-4cb4-9683-f92f272e4358/migrator/0.log" Jul 08 19:47:11.639927 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:11.639902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-6hm69_c8f6e680-647d-4cb4-9683-f92f272e4358/graceful-termination/0.log" Jul 08 19:47:13.040000 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.039973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/kube-multus-additional-cni-plugins/0.log" Jul 08 19:47:13.069076 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.069051 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/egress-router-binary-copy/0.log" Jul 08 19:47:13.099142 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.099106 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/cni-plugins/0.log" Jul 08 19:47:13.130746 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.130725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/bond-cni-plugin/0.log" Jul 08 19:47:13.156981 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.156958 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/routeoverride-cni/0.log" Jul 08 19:47:13.180251 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.180227 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/whereabouts-cni-bincopy/0.log" Jul 08 19:47:13.200827 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.200804 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb2rm_b9c14c52-a3bc-4850-b500-3fac7a15f33e/whereabouts-cni/0.log" Jul 08 19:47:13.621908 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.621877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n9r2s_d6512e99-de0c-4f7b-804d-231b6f38ac55/kube-multus/0.log" Jul 08 19:47:13.672015 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.671990 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b7nn_fc37c758-7eff-42f2-9c79-6383b3c01abf/network-metrics-daemon/0.log" Jul 08 19:47:13.694895 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:13.694869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b7nn_fc37c758-7eff-42f2-9c79-6383b3c01abf/kube-rbac-proxy/0.log" Jul 08 19:47:14.608087 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.608058 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/ovn-controller/0.log" Jul 08 19:47:14.626398 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.626370 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/ovn-acl-logging/0.log" Jul 08 19:47:14.653022 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.652991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/kube-rbac-proxy-node/0.log" Jul 08 19:47:14.674119 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.674087 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 19:47:14.691873 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.691842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/northd/0.log" Jul 08 19:47:14.712480 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.712451 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/nbdb/0.log" Jul 08 19:47:14.732499 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.732473 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/sbdb/0.log" Jul 08 19:47:14.769907 ip-10-0-131-119 kubenswrapper[2559]: I0708 19:47:14.769878 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8cg2d_84ff4ed4-11e3-4ee1-95ea-6f82e1396a79/ovnkube-controller/0.log"