Jul 29 14:59:34.007801 ip-10-0-130-151 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 14:59:34.007815 ip-10-0-130-151 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 14:59:34.007822 ip-10-0-130-151 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 14:59:34.008135 ip-10-0-130-151 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 14:59:44.254941 ip-10-0-130-151 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 14:59:44.254960 ip-10-0-130-151 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e7441032447c4679b083da09cd9d5934 -- Jul 29 15:01:43.688428 ip-10-0-130-151 systemd[1]: Starting Kubernetes Kubelet... Jul 29 15:01:44.024715 ip-10-0-130-151 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.024715 ip-10-0-130-151 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 15:01:44.024715 ip-10-0-130-151 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.024715 ip-10-0-130-151 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 15:01:44.024715 ip-10-0-130-151 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 15:01:44.025444 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.025288 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 15:01:44.028767 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028751 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.028767 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028767 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028771 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028775 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028778 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028781 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028784 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028787 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028789 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028792 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028795 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028802 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028805 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028808 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028810 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028813 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028816 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028818 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028821 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028824 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028826 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.028835 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028829 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028831 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028834 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028837 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028839 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028843 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028845 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028848 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028851 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028853 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028856 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028858 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028861 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028863 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028866 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028868 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028871 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028873 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028876 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028878 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.029323 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028881 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028883 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028885 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028890 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028893 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028896 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028898 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028901 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028903 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028905 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028908 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028910 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028912 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028915 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028919 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028922 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028925 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028927 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028930 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028932 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.029836 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028934 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028937 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028941 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028944 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028947 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028950 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028952 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.028955 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029007 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029013 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029015 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029022 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029025 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029029 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029032 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029034 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029038 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029040 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029042 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.030342 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029045 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029048 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029050 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029053 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029055 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029058 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029060 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029063 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029065 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029068 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029070 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029073 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029075 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029078 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029080 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029082 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029085 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029087 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029089 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029789 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.030800 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029795 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029799 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029802 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029805 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029809 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029814 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029817 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029820 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029822 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029825 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029828 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029830 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029833 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029835 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029838 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029841 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029844 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029846 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029849 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.031293 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029851 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029854 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029856 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029859 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029861 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029864 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029866 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029869 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029871 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029873 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029876 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029878 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029881 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029883 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029885 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029888 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029890 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029893 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029898 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029903 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.031831 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029906 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029909 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029913 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029915 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029918 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029920 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029923 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029925 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029928 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029930 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029933 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029936 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029938 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029941 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029944 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029946 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029949 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029951 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029953 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029956 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.032707 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029960 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029964 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029967 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029970 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029973 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029976 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029979 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029981 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029984 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029987 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029992 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029994 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.029998 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030000 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030003 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030006 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030008 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030011 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030013 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030015 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.033333 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030018 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030020 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030023 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030025 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030028 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030030 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030033 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030035 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030038 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030041 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030043 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030046 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030048 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030051 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030053 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030056 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030058 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030061 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030063 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030452 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.033817 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030458 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030461 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030465 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030468 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030482 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030486 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030488 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030491 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030494 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030497 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030499 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030502 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030505 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030507 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030510 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030528 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030532 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030534 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030537 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030539 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.034321 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030542 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030545 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030547 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030550 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030553 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030555 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030558 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030560 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030563 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030565 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030568 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030570 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030573 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030575 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030579 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030582 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030584 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030592 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030595 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030598 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.034801 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030600 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030602 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030605 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030607 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030610 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030613 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030615 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030618 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030620 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030622 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030625 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030627 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030629 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030632 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030634 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030636 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030639 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030642 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030644 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.035309 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030647 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030649 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030651 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030654 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030656 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030658 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030661 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030664 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030667 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030669 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030672 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030681 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030684 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030687 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030689 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030692 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030695 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030697 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030699 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030702 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.035775 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030704 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030707 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030709 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030711 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030714 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030716 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030720 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030723 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030726 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030732 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030735 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030737 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030740 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030744 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030747 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030751 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030755 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030758 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.030760 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.036285 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030822 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030829 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030835 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030839 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030842 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030857 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030862 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030865 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030868 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030871 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030874 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030878 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030880 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030883 2562 flags.go:64] FLAG: --cgroup-root="" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030886 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030888 2562 flags.go:64] FLAG: --client-ca-file="" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030891 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030894 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030901 2562 flags.go:64] FLAG: --cluster-domain="" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030903 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030906 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030909 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030914 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030917 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 15:01:44.036737 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030920 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030923 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030926 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030929 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030931 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030934 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030937 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030939 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030944 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030947 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030950 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030952 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030955 2562 flags.go:64] FLAG: --enable-server="true" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030958 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030973 2562 flags.go:64] FLAG: --event-burst="100" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030976 2562 flags.go:64] FLAG: --event-qps="50" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030979 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030981 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030984 2562 flags.go:64] FLAG: --eviction-hard="" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030987 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030990 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030993 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030996 2562 flags.go:64] FLAG: --eviction-soft="" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.030999 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031001 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 15:01:44.037430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031004 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031007 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031009 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031012 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031014 2562 flags.go:64] FLAG: --feature-gates="" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031019 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031022 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031025 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031028 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031031 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031033 2562 flags.go:64] FLAG: --help="false" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031036 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031039 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031042 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031044 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031049 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031052 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031055 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031057 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031060 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031063 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031065 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031074 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031076 2562 flags.go:64] FLAG: --kube-reserved="" Jul 29 15:01:44.038075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031079 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031082 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031085 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031088 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031090 2562 flags.go:64] FLAG: --lock-file="" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031093 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031096 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031098 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031104 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031106 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031109 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031112 2562 flags.go:64] FLAG: --logging-format="text" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031114 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031118 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031121 2562 flags.go:64] FLAG: --manifest-url="" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031124 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031127 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031130 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031134 2562 flags.go:64] FLAG: --max-pods="110" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031137 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031158 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031162 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031165 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031169 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031172 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 15:01:44.038675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031175 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031181 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031184 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031187 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031190 2562 flags.go:64] FLAG: --pod-cidr="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031193 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031207 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031210 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031212 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031215 2562 flags.go:64] FLAG: --port="10250" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031218 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031221 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04be2edb89dc45aed" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031224 2562 flags.go:64] FLAG: --qos-reserved="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031226 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031229 2562 flags.go:64] FLAG: --register-node="true" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031232 2562 flags.go:64] FLAG: --register-with-taints="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031235 2562 flags.go:64] FLAG: --registry-burst="10" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031238 2562 flags.go:64] FLAG: --registry-qps="5" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031241 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031243 2562 flags.go:64] FLAG: --reserved-memory="" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031248 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031251 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031253 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031256 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031259 2562 flags.go:64] FLAG: --runonce="false" Jul 29 15:01:44.039657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031262 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031264 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031267 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031270 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031272 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031275 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031279 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031282 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031285 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031287 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031290 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031293 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031296 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031299 2562 flags.go:64] FLAG: --system-cgroups="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031307 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031312 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031315 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031317 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031324 2562 flags.go:64] FLAG: --tls-min-version="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031326 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031329 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031332 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031334 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031337 2562 flags.go:64] FLAG: --v="2" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031341 2562 flags.go:64] FLAG: --version="false" Jul 29 15:01:44.040757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031345 2562 flags.go:64] FLAG: --vmodule="" Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031348 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.031352 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031529 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031532 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031535 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031538 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031541 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031544 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031546 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031549 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031551 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031554 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031557 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031559 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031568 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031571 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031574 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031576 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.041884 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031580 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031583 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031586 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.031625 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.032987 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033106 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033112 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033115 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033118 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033121 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033124 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033128 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033130 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033133 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033135 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033138 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033157 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033163 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033167 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033169 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.042745 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033172 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033175 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033177 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033180 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033182 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033185 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033187 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033190 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033192 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033195 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033197 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033200 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033202 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033205 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033207 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033210 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033213 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033217 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033220 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033223 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.043473 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033226 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033228 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033231 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033234 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033236 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033239 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033243 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033246 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033250 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033253 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033255 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033258 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033261 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033263 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033266 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033268 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033271 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033273 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033276 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033279 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.044361 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033281 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033284 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033287 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033289 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033292 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033294 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033297 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033299 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033301 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033305 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033308 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033310 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033313 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033315 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033318 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033320 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033323 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033325 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033328 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033330 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.045058 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033333 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033335 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.033338 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.033831 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.041277 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.041297 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.041326 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.041335 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041424 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041432 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041437 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041442 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041447 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041452 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.048830 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041457 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041464 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041469 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041473 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041478 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041483 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041487 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041491 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041496 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041501 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041505 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041510 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041514 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041518 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041523 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041527 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041531 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041536 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041540 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.050043 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041544 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041549 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041553 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041557 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041562 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041569 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041575 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041580 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041584 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041589 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041594 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041599 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041604 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041608 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041612 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041617 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041621 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041625 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041629 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.050527 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041633 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041638 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041642 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041647 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041651 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041656 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041660 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041665 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041669 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041674 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041678 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041682 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041687 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041691 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041696 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041700 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041704 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041709 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041716 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.050998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041731 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041737 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041742 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041746 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041750 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041755 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041759 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041763 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041768 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041772 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041776 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041780 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041784 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041789 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041793 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041797 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041801 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041805 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041809 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041814 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041818 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.051489 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041823 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041827 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041831 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041836 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041840 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041844 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041848 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041853 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041857 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041862 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041867 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041871 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041877 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041881 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.041885 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.053484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.041892 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042075 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042083 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042090 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042096 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042101 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042106 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042111 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042115 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042120 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042124 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042129 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042133 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042137 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042161 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042166 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042171 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042175 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042179 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042184 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 15:01:44.053902 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042188 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042192 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042196 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042201 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042205 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042210 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042215 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042220 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042224 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042228 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042234 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042238 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042243 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042247 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042252 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042255 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042260 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042264 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042268 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042273 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 15:01:44.054419 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042277 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042282 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042287 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042291 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042295 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042300 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042305 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042309 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042313 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042318 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042322 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042326 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042330 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042334 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042339 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042344 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042348 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042352 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042357 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042362 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 15:01:44.054906 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042367 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042371 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042376 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042381 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042386 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042390 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042394 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042399 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042403 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042407 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042412 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042416 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042420 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042424 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042429 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042436 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042441 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042446 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042451 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042455 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 15:01:44.055410 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042459 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042464 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042468 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042472 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042477 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042481 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042486 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042490 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042494 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042499 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042503 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042510 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042515 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042520 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042525 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042529 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042536 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042540 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042544 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 15:01:44.055889 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:44.042548 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.042557 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.042717 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.045354 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.048806 2562 server.go:1019] "Starting client certificate rotation" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.050978 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.051032 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.051389 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 15:01:44.056501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.053393 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 15:01:44.059890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.059874 2562 log.go:25] "Validated CRI v1 runtime API" Jul 29 15:01:44.061890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.061877 2562 log.go:25] "Validated CRI v1 image API" Jul 29 15:01:44.062726 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.062710 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 15:01:44.065564 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.065547 2562 fs.go:135] Filesystem UUIDs: map[01bad5c1-f65e-4121-ac39-ece72356e4ec:/dev/nvme0n1p3 2697b319-3730-4cd9-bf09-4da4bd1116c8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 29 15:01:44.065617 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.065564 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 15:01:44.071964 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.071848 2562 manager.go:216] Machine: {Timestamp:2026-07-29 15:01:44.070665166 +0000 UTC m=+0.277427897 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099873 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26744806d8302b0f240585cd42e845 SystemUUID:ec267448-06d8-302b-0f24-0585cd42e845 BootID:e7441032-447c-4679-b083-da09cd9d5934 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:86:7e:65:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:86:7e:65:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:05:a7:47:29:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 15:01:44.071964 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.071953 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 15:01:44.072118 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.072029 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 15:01:44.074824 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.074793 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 15:01:44.074997 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.074827 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-151.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 15:01:44.075497 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.075484 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 15:01:44.075551 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.075503 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 15:01:44.075551 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.075514 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:44.075955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.075943 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 15:01:44.077163 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.077134 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 15:01:44.079740 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.079726 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:44.079887 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.079875 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 15:01:44.080461 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080450 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 29 15:01:44.080514 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080468 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 15:01:44.080514 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080483 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 15:01:44.080514 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080498 2562 kubelet.go:398] "Adding apiserver pod source" Jul 29 15:01:44.080514 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080510 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 15:01:44.080883 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080870 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:44.080950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.080893 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 15:01:44.082927 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.082902 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 15:01:44.084323 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084309 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 15:01:44.084369 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084340 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 15:01:44.084866 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084856 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 15:01:44.084906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084872 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 15:01:44.084906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084877 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 15:01:44.084906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084883 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 15:01:44.084906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084891 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 15:01:44.084906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084896 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084927 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084933 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084939 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084944 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084953 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 15:01:44.085054 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.084961 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 15:01:44.086321 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.086311 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 15:01:44.086321 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.086322 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 15:01:44.087684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.087660 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:44.089970 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.089954 2562 server.go:1268] "Started kubelet" Jul 29 15:01:44.090047 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.090003 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 15:01:44.090135 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.090074 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 15:01:44.090247 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.090214 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 15:01:44.090814 ip-10-0-130-151 systemd[1]: Started Kubernetes Kubelet. Jul 29 15:01:44.091487 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.091471 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-151.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 15:01:44.091827 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.091808 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 15:01:44.091920 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.091837 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 15:01:44.091920 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.091837 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 15:01:44.092395 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.092378 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 29 15:01:44.095792 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.095764 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 15:01:44.095792 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.094914 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a6885dbd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.089910717 +0000 UTC m=+0.296673439,LastTimestamp:2026-07-29 15:01:44.089910717 +0000 UTC m=+0.296673439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.097945 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.097926 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 15:01:44.097945 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.097932 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:44.098091 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.098019 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.098466 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098441 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 15:01:44.098466 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098462 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 15:01:44.098609 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098544 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 15:01:44.098675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098656 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 29 15:01:44.098675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098672 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 29 15:01:44.098824 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098816 2562 factory.go:55] Registering systemd factory Jul 29 15:01:44.098880 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.098832 2562 factory.go:223] Registration of the systemd container factory successfully Jul 29 15:01:44.099114 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099092 2562 factory.go:153] Registering CRI-O factory Jul 29 15:01:44.099114 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099114 2562 factory.go:223] Registration of the crio container factory successfully Jul 29 15:01:44.099284 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099193 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 15:01:44.099284 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099217 2562 factory.go:103] Registering Raw factory Jul 29 15:01:44.099284 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099231 2562 manager.go:1196] Started watching for new ooms in manager Jul 29 15:01:44.099963 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.099934 2562 manager.go:349] Starting recovery of all containers Jul 29 15:01:44.100595 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.100566 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 15:01:44.106537 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.106508 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 15:01:44.109993 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.109884 2562 manager.go:354] Recovery completed Jul 29 15:01:44.112131 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.112086 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 15:01:44.114282 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.114269 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.115943 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.115928 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.116011 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.115956 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.116011 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.115967 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.116492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.116477 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 15:01:44.116547 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.116493 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 15:01:44.116547 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.116511 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 29 15:01:44.116547 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.116482 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.117191 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117176 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.117252 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117199 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.117252 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117212 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.117851 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117840 2562 policy_none.go:49] "None policy: Start" Jul 29 15:01:44.117890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117855 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 15:01:44.117890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.117866 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 15:01:44.118992 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.118982 2562 policy_none.go:47] "Start" Jul 29 15:01:44.125748 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.125666 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a8159612 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.11594293 +0000 UTC m=+0.322705650,LastTimestamp:2026-07-29 15:01:44.11594293 +0000 UTC m=+0.322705650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.136894 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.136824 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a815deb4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.115961524 +0000 UTC m=+0.322724245,LastTimestamp:2026-07-29 15:01:44.115961524 +0000 UTC m=+0.322724245,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.145984 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.145919 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a81603f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.115971057 +0000 UTC m=+0.322733778,LastTimestamp:2026-07-29 15:01:44.115971057 +0000 UTC m=+0.322733778,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.154611 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.154516 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-151.ec2.internal.18c6cad1a8159612\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a8159612 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.11594293 +0000 UTC m=+0.322705650,LastTimestamp:2026-07-29 15:01:44.117189179 +0000 UTC m=+0.323951899,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.154804 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.154793 2562 manager.go:337] "Starting Device Plugin manager" Jul 29 15:01:44.154845 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.154823 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 15:01:44.154845 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.154832 2562 server.go:87] "Starting device plugin registration server" Jul 29 15:01:44.155095 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.155079 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 15:01:44.155208 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.155096 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 15:01:44.155208 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.155176 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 15:01:44.155273 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.155247 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 15:01:44.155273 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.155256 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 15:01:44.155920 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.155893 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 15:01:44.156011 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.155960 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.163385 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.163326 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-151.ec2.internal.18c6cad1a815deb4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a815deb4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.115961524 +0000 UTC m=+0.322724245,LastTimestamp:2026-07-29 15:01:44.117204595 +0000 UTC m=+0.323967318,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.171713 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.171653 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-151.ec2.internal.18c6cad1a81603f1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1a81603f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-151.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.115971057 +0000 UTC m=+0.322733778,LastTimestamp:2026-07-29 15:01:44.117218082 +0000 UTC m=+0.323980806,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.179708 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.179650 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-151.ec2.internal.18c6cad1aa87f87b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-151.ec2.internal,UID:ip-10-0-130-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-130-151.ec2.internal,},FirstTimestamp:2026-07-29 15:01:44.156993659 +0000 UTC m=+0.363756367,LastTimestamp:2026-07-29 15:01:44.156993659 +0000 UTC m=+0.363756367,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-151.ec2.internal,}" Jul 29 15:01:44.186917 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.186894 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lnp7b" Jul 29 15:01:44.196673 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.196650 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lnp7b" Jul 29 15:01:44.255382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.255348 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.257450 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.256344 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.257450 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.256373 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.257450 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.256383 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.257450 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.256415 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.276585 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.276524 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.276585 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.276550 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-151.ec2.internal\": node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.303726 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.303702 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 15:01:44.303856 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.303744 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 15:01:44.303856 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.303763 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 15:01:44.303856 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.303805 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 15:01:44.306938 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.306919 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:44.311503 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.311487 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.404440 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.404404 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal"] Jul 29 15:01:44.404527 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.404476 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.405952 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.405938 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.406031 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.405969 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.406031 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.405978 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.408128 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408114 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.408271 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.408328 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408291 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.408905 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408888 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.408998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408913 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.408998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408920 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.408998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408931 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.408998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408934 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.408998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.408940 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.411075 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.411058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.411172 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.411090 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 15:01:44.411565 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.411552 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.411840 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.411824 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientMemory" Jul 29 15:01:44.411932 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.411858 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 15:01:44.411932 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.411875 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeHasSufficientPID" Jul 29 15:01:44.436937 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.436913 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-151.ec2.internal\" not found" node="ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.441672 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.441652 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-151.ec2.internal\" not found" node="ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.512230 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.512196 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.599913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.599824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.599913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.599857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.599913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.599879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe1a7c4734bb08de9989144eeaa56b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-151.ec2.internal\" (UID: \"afe1a7c4734bb08de9989144eeaa56b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.612925 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.612899 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.700283 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.700374 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.700374 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe1a7c4734bb08de9989144eeaa56b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-151.ec2.internal\" (UID: \"afe1a7c4734bb08de9989144eeaa56b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.700374 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700358 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe1a7c4734bb08de9989144eeaa56b2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-151.ec2.internal\" (UID: \"afe1a7c4734bb08de9989144eeaa56b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.700468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.700468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.700359 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed97c7e1ca27213276dd4347a4081684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal\" (UID: \"ed97c7e1ca27213276dd4347a4081684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.713368 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.713339 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.739531 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.739512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.744563 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.744549 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:44.813604 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.813559 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.914128 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:44.914046 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-151.ec2.internal\" not found" Jul 29 15:01:44.920583 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.920565 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:44.998201 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:44.998163 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" Jul 29 15:01:45.026887 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.026853 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.028246 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.028227 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" Jul 29 15:01:45.047789 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.047766 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 15:01:45.047866 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.047844 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 15:01:45.047904 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.047874 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:01:45.047938 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.047899 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 15:01:45.081067 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.081049 2562 apiserver.go:52] "Watching apiserver" Jul 29 15:01:45.095680 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.095651 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 15:01:45.096574 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.096557 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal","openshift-multus/multus-additional-cni-plugins-qp766","openshift-multus/multus-c2jfn","kube-system/global-pull-secret-syncer-5bv4x","kube-system/konnectivity-agent-jrrhj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt","openshift-image-registry/node-ca-n29qb","openshift-multus/network-metrics-daemon-4lhch","openshift-network-diagnostics/network-check-target-75jqd","openshift-network-operator/iptables-alerter-fq6vl","openshift-ovn-kubernetes/ovnkube-node-nt92p","kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vn4s9","openshift-dns/node-resolver-gfvf2"] Jul 29 15:01:45.098535 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.098519 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 15:01:45.099084 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.099066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.101534 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.101634 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cnibin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101634 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-os-release\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101634 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-hostroot\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101634 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-conf-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-daemon-config\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-etc-kubernetes\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzswf\" (UniqueName: \"kubernetes.io/projected/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-kube-api-access-bzswf\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.101820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cnibin\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.101820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8484\" (UniqueName: \"kubernetes.io/projected/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-kube-api-access-c8484\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-socket-dir-parent\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.101976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-bin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-os-release\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.102076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-k8s-cni-cncf-io\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-netns\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-multus\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-system-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cni-binary-copy\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-kubelet\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-multus-certs\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.102458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.102305 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.103802 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.103779 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 15:01:45.103879 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.103833 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7hdt\"" Jul 29 15:01:45.104308 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.104294 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 15:01:45.104391 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.104375 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.104527 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.104512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.104582 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.104564 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:45.104619 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.104604 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.105016 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.104998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-phm78\"" Jul 29 15:01:45.105116 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.105101 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 15:01:45.105944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.105931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 15:01:45.106484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.106470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.108525 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.108511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.108952 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.108937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 15:01:45.109040 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.109024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x42vx\"" Jul 29 15:01:45.109497 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.109482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 15:01:45.110556 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.110543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.111636 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.111620 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.111636 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.111629 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 15:01:45.111764 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.111685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94cj2\"" Jul 29 15:01:45.111846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.111832 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.112620 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.112608 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.112668 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.112655 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:45.112924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.112908 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 15:01:45.113583 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.113569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.114875 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.114859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:45.114984 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.114938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:45.115251 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.115234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.115931 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.115911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlj25\"" Jul 29 15:01:45.117000 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.116982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.119433 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.119414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.121842 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.121826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.122787 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.122769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.123440 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.123427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.123971 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.123958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.124662 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.124645 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p5w9j\"" Jul 29 15:01:45.124740 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.124727 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 15:01:45.139620 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.139600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 15:01:45.139702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.139638 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.139702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.139654 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.139702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.139682 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 15:01:45.140453 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140440 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.140500 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140440 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.140616 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140589 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 15:01:45.140719 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140672 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xq6f7\"" Jul 29 15:01:45.140817 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jhtdf\"" Jul 29 15:01:45.140863 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wl77f\"" Jul 29 15:01:45.140902 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 15:01:45.140938 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.140905 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 15:01:45.144877 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.144850 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 15:01:45.145058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.145045 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 15:01:45.166848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.166803 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vxpln" Jul 29 15:01:45.179723 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.179705 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vxpln" Jul 29 15:01:45.199543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.199524 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 15:01:45.199881 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.199830 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 14:56:44 +0000 UTC" deadline="2028-01-29 12:39:31.910701446 +0000 UTC" Jul 29 15:01:45.199943 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.199882 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13173h37m46.710822816s" Jul 29 15:01:45.202617 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd79d\" (UniqueName: \"kubernetes.io/projected/ab8cb8a0-48c2-4730-a94b-86be1b14025d-kube-api-access-zd79d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.202702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysconfig\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.202702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.202784 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-systemd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.202784 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-env-overrides\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.202784 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-kubelet-config\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpt5\" (UniqueName: \"kubernetes.io/projected/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-kube-api-access-nkpt5\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-modprobe-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-k8s-cni-cncf-io\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202854 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-netns\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202901 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-netns\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-config\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202915 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-k8s-cni-cncf-io\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.202950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-kubelet\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.202969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-kubernetes\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-run\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-registration-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-host-slash\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-ovn\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-bin\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99aa0c42-14e4-4267-be04-9d7a4e2e0096-hosts-file\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-hostroot\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-conf-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8484\" (UniqueName: \"kubernetes.io/projected/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-kube-api-access-c8484\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203261 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-hostroot\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-bin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203313 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-conf-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-multus-certs\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203300 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-bin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-os-release\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-run-multus-certs\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203388 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-os-release\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-var-lib-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893997c6-be51-4a60-9394-8d135ca6bbbb-agent-certs\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqhs\" (UniqueName: \"kubernetes.io/projected/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-kube-api-access-ckqhs\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cni-binary-copy\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-etc-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w48f4\" (UniqueName: \"kubernetes.io/projected/3843e12b-7039-4974-88a8-a850cad2bdbd-kube-api-access-w48f4\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-daemon-config\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzswf\" (UniqueName: \"kubernetes.io/projected/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-kube-api-access-bzswf\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.203924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-multus\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-log-socket\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-netd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-cni-multus\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-script-lib\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-slash\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-system-cni-dir\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-node-log\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.203951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovn-node-metrics-cert\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-dbus\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204060 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-daemon-config\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204063 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cni-binary-copy\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptvzn\" (UniqueName: \"kubernetes.io/projected/031d0230-5940-4209-8211-f60cb3c2986f-kube-api-access-ptvzn\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.204711 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-conf\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-system-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-kubelet\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-system-cni-dir\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-host\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204260 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-host-var-lib-kubelet\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893997c6-be51-4a60-9394-8d135ca6bbbb-konnectivity-ca\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-sys-fs\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-host\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-os-release\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxjpk\" (UniqueName: \"kubernetes.io/projected/84287bc9-df3c-49f9-94a8-87beff5dbf4a-kube-api-access-sxjpk\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-lib-modules\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-os-release\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99aa0c42-14e4-4267-be04-9d7a4e2e0096-tmp-dir\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.205484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cnibin\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-socket-dir-parent\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-device-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204590 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cnibin\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-iptables-alerter-script\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-multus-socket-dir-parent\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-systemd-units\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-netns\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-systemd\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-sys\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-var-lib-kubelet\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-serviceca\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-tmp\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.205955 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvw7x\" (UniqueName: \"kubernetes.io/projected/99aa0c42-14e4-4267-be04-9d7a4e2e0096-kube-api-access-jvw7x\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-socket-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cnibin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-etc-kubernetes\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-tuned\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204966 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-etc-kubernetes\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.204977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-cnibin\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.206558 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.205373 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.216489 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.216471 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 15:01:45.219666 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.219647 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzswf\" (UniqueName: \"kubernetes.io/projected/09b7ba2b-9a63-49eb-bff8-5da0ce48528e-kube-api-access-bzswf\") pod \"multus-c2jfn\" (UID: \"09b7ba2b-9a63-49eb-bff8-5da0ce48528e\") " pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.219886 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.219870 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8484\" (UniqueName: \"kubernetes.io/projected/eefb86b4-c29f-4d91-bdf2-431cfe31a4bf-kube-api-access-c8484\") pod \"multus-additional-cni-plugins-qp766\" (UID: \"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf\") " pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.305159 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-host-slash\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-ovn\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-bin\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-host-slash\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99aa0c42-14e4-4267-be04-9d7a4e2e0096-hosts-file\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305314 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-ovn\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305309 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99aa0c42-14e4-4267-be04-9d7a4e2e0096-hosts-file\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.305338 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-bin\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-var-lib-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305356 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305363 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-var-lib-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893997c6-be51-4a60-9394-8d135ca6bbbb-agent-certs\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqhs\" (UniqueName: \"kubernetes.io/projected/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-kube-api-access-ckqhs\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.305409 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-etc-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w48f4\" (UniqueName: \"kubernetes.io/projected/3843e12b-7039-4974-88a8-a850cad2bdbd-kube-api-access-w48f4\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-etc-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.305562 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:45.805539276 +0000 UTC m=+2.012301987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305576 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-openvswitch\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-log-socket\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305622 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-log-socket\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-netd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.305770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-script-lib\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-slash\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305708 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-cni-netd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-node-log\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-slash\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305762 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-node-log\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovn-node-metrics-cert\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-dbus\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvzn\" (UniqueName: \"kubernetes.io/projected/031d0230-5940-4209-8211-f60cb3c2986f-kube-api-access-ptvzn\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-conf\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305910 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-dbus\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-host\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.305989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893997c6-be51-4a60-9394-8d135ca6bbbb-konnectivity-ca\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-sys-fs\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.306611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-host\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjpk\" (UniqueName: \"kubernetes.io/projected/84287bc9-df3c-49f9-94a8-87beff5dbf4a-kube-api-access-sxjpk\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-lib-modules\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306084 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-conf\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-script-lib\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306211 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-lib-modules\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-sys-fs\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306193 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysctl-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-host\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99aa0c42-14e4-4267-be04-9d7a4e2e0096-tmp-dir\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-device-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-iptables-alerter-script\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-systemd-units\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-netns\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306264 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-host\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.307648 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-systemd\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-sys\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-run-netns\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306486 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-device-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-systemd-units\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306500 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99aa0c42-14e4-4267-be04-9d7a4e2e0096-tmp-dir\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306532 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-systemd\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-var-lib-kubelet\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-var-lib-kubelet\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-serviceca\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306588 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-sys\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-tmp\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvw7x\" (UniqueName: \"kubernetes.io/projected/99aa0c42-14e4-4267-be04-9d7a4e2e0096-kube-api-access-jvw7x\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-socket-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-tuned\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893997c6-be51-4a60-9394-8d135ca6bbbb-konnectivity-ca\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.308510 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd79d\" (UniqueName: \"kubernetes.io/projected/ab8cb8a0-48c2-4730-a94b-86be1b14025d-kube-api-access-zd79d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysconfig\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-systemd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-env-overrides\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-kubelet-config\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpt5\" (UniqueName: \"kubernetes.io/projected/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-kube-api-access-nkpt5\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306840 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-socket-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-modprobe-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306872 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-sysconfig\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-config\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-kubelet\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306947 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-iptables-alerter-script\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-kubernetes\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.306988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-run\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-registration-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-serviceca\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.309411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307079 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-host-kubelet\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307107 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3843e12b-7039-4974-88a8-a850cad2bdbd-registration-dir\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.307129 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307191 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-modprobe-d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.307215 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:45.80719942 +0000 UTC m=+2.013962131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307236 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4620880-af96-4b41-b6fc-2bf2e816aaa7-kubelet-config\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-kubernetes\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8cb8a0-48c2-4730-a94b-86be1b14025d-run\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307310 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/84287bc9-df3c-49f9-94a8-87beff5dbf4a-run-systemd\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.307466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-env-overrides\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.308069 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovnkube-config\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.308396 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893997c6-be51-4a60-9394-8d135ca6bbbb-agent-certs\") pod \"konnectivity-agent-jrrhj\" (UID: \"893997c6-be51-4a60-9394-8d135ca6bbbb\") " pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.309108 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-tmp\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.309355 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8cb8a0-48c2-4730-a94b-86be1b14025d-etc-tuned\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.309870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.309428 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/84287bc9-df3c-49f9-94a8-87beff5dbf4a-ovn-node-metrics-cert\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.325655 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.325615 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:45.325655 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.325640 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:45.325655 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.325655 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:45.326217 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.325712 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:45.825695109 +0000 UTC m=+2.032457842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:45.326769 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.326741 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd79d\" (UniqueName: \"kubernetes.io/projected/ab8cb8a0-48c2-4730-a94b-86be1b14025d-kube-api-access-zd79d\") pod \"tuned-vn4s9\" (UID: \"ab8cb8a0-48c2-4730-a94b-86be1b14025d\") " pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.327094 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.327071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjpk\" (UniqueName: \"kubernetes.io/projected/84287bc9-df3c-49f9-94a8-87beff5dbf4a-kube-api-access-sxjpk\") pod \"ovnkube-node-nt92p\" (UID: \"84287bc9-df3c-49f9-94a8-87beff5dbf4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.327543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.327470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqhs\" (UniqueName: \"kubernetes.io/projected/4bb1c00e-bf26-4a47-b47d-ce69153e0ac3-kube-api-access-ckqhs\") pod \"iptables-alerter-fq6vl\" (UID: \"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3\") " pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.327543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.327495 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvzn\" (UniqueName: \"kubernetes.io/projected/031d0230-5940-4209-8211-f60cb3c2986f-kube-api-access-ptvzn\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.329594 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.329570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpt5\" (UniqueName: \"kubernetes.io/projected/93c25b1d-01be-41b4-9981-bfbcfc4a15d9-kube-api-access-nkpt5\") pod \"node-ca-n29qb\" (UID: \"93c25b1d-01be-41b4-9981-bfbcfc4a15d9\") " pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.329935 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.329912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvw7x\" (UniqueName: \"kubernetes.io/projected/99aa0c42-14e4-4267-be04-9d7a4e2e0096-kube-api-access-jvw7x\") pod \"node-resolver-gfvf2\" (UID: \"99aa0c42-14e4-4267-be04-9d7a4e2e0096\") " pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.330040 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.330026 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w48f4\" (UniqueName: \"kubernetes.io/projected/3843e12b-7039-4974-88a8-a850cad2bdbd-kube-api-access-w48f4\") pod \"aws-ebs-csi-driver-node-dc4dt\" (UID: \"3843e12b-7039-4974-88a8-a850cad2bdbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.347037 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.347006 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded97c7e1ca27213276dd4347a4081684.slice/crio-8b0af0d6e65c871bd2daba55ff7f1af634603a8f1f40506624e6cdaf52749e21 WatchSource:0}: Error finding container 8b0af0d6e65c871bd2daba55ff7f1af634603a8f1f40506624e6cdaf52749e21: Status 404 returned error can't find the container with id 8b0af0d6e65c871bd2daba55ff7f1af634603a8f1f40506624e6cdaf52749e21 Jul 29 15:01:45.347383 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.347364 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe1a7c4734bb08de9989144eeaa56b2.slice/crio-d4ca4b9e918b4d777b707075d22a63b88724447281569a24f3a090e1e7fdf7cc WatchSource:0}: Error finding container d4ca4b9e918b4d777b707075d22a63b88724447281569a24f3a090e1e7fdf7cc: Status 404 returned error can't find the container with id d4ca4b9e918b4d777b707075d22a63b88724447281569a24f3a090e1e7fdf7cc Jul 29 15:01:45.352016 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.352003 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:01:45.431900 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.431824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qp766" Jul 29 15:01:45.441986 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.441962 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefb86b4_c29f_4d91_bdf2_431cfe31a4bf.slice/crio-a28ddbf9ef8d107a1ce1d7621ab65ae5cc9299c6c1965f7dbcc19fc98576cf84 WatchSource:0}: Error finding container a28ddbf9ef8d107a1ce1d7621ab65ae5cc9299c6c1965f7dbcc19fc98576cf84: Status 404 returned error can't find the container with id a28ddbf9ef8d107a1ce1d7621ab65ae5cc9299c6c1965f7dbcc19fc98576cf84 Jul 29 15:01:45.448443 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.448422 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2jfn" Jul 29 15:01:45.455399 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.455379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:01:45.457723 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.457699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b7ba2b_9a63_49eb_bff8_5da0ce48528e.slice/crio-1921cefdf53328df492f588879a82fee4faa28fe19024e47912058e1b1e27c5b WatchSource:0}: Error finding container 1921cefdf53328df492f588879a82fee4faa28fe19024e47912058e1b1e27c5b: Status 404 returned error can't find the container with id 1921cefdf53328df492f588879a82fee4faa28fe19024e47912058e1b1e27c5b Jul 29 15:01:45.464069 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.464044 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893997c6_be51_4a60_9394_8d135ca6bbbb.slice/crio-0bd7589a62cf00a38bfde320a578738e219c9cdf3414f3a92f12bb4baf099966 WatchSource:0}: Error finding container 0bd7589a62cf00a38bfde320a578738e219c9cdf3414f3a92f12bb4baf099966: Status 404 returned error can't find the container with id 0bd7589a62cf00a38bfde320a578738e219c9cdf3414f3a92f12bb4baf099966 Jul 29 15:01:45.468843 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.468821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" Jul 29 15:01:45.477512 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.477495 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3843e12b_7039_4974_88a8_a850cad2bdbd.slice/crio-8293a5fbecbb67f40f1e7a95dfb87ed200912c3c1f84fdea8738550863bff2df WatchSource:0}: Error finding container 8293a5fbecbb67f40f1e7a95dfb87ed200912c3c1f84fdea8738550863bff2df: Status 404 returned error can't find the container with id 8293a5fbecbb67f40f1e7a95dfb87ed200912c3c1f84fdea8738550863bff2df Jul 29 15:01:45.483420 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.483404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n29qb" Jul 29 15:01:45.491232 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.491207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c25b1d_01be_41b4_9981_bfbcfc4a15d9.slice/crio-f37d9b45b917442fb4747e46b94cd9c7689c0c630ed3c22a4c33123fe7aec115 WatchSource:0}: Error finding container f37d9b45b917442fb4747e46b94cd9c7689c0c630ed3c22a4c33123fe7aec115: Status 404 returned error can't find the container with id f37d9b45b917442fb4747e46b94cd9c7689c0c630ed3c22a4c33123fe7aec115 Jul 29 15:01:45.496555 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.496539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fq6vl" Jul 29 15:01:45.501605 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.501584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:01:45.504612 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.504506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb1c00e_bf26_4a47_b47d_ce69153e0ac3.slice/crio-6fdb306ffff2483c6eb10a44de67c21f7f45e98e6a0bb24918e70d49f644b69d WatchSource:0}: Error finding container 6fdb306ffff2483c6eb10a44de67c21f7f45e98e6a0bb24918e70d49f644b69d: Status 404 returned error can't find the container with id 6fdb306ffff2483c6eb10a44de67c21f7f45e98e6a0bb24918e70d49f644b69d Jul 29 15:01:45.507650 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.507631 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.510652 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.510632 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84287bc9_df3c_49f9_94a8_87beff5dbf4a.slice/crio-e27ef329e880e9e5576f06edd0dee55534e6f0a3b6222e0e78bcb1aacb34a943 WatchSource:0}: Error finding container e27ef329e880e9e5576f06edd0dee55534e6f0a3b6222e0e78bcb1aacb34a943: Status 404 returned error can't find the container with id e27ef329e880e9e5576f06edd0dee55534e6f0a3b6222e0e78bcb1aacb34a943 Jul 29 15:01:45.536257 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.536237 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" Jul 29 15:01:45.541112 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.541089 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfvf2" Jul 29 15:01:45.545013 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.544991 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8cb8a0_48c2_4730_a94b_86be1b14025d.slice/crio-fcecef9aef0b731235827c2fa69be4ddd43dee0c8d584d3697aa3a1c967abc2d WatchSource:0}: Error finding container fcecef9aef0b731235827c2fa69be4ddd43dee0c8d584d3697aa3a1c967abc2d: Status 404 returned error can't find the container with id fcecef9aef0b731235827c2fa69be4ddd43dee0c8d584d3697aa3a1c967abc2d Jul 29 15:01:45.550790 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:01:45.550770 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99aa0c42_14e4_4267_be04_9d7a4e2e0096.slice/crio-38109320a40e2d9bd06786ee1da3b4e241d6b4ddea55e60f670337dc40ff0626 WatchSource:0}: Error finding container 38109320a40e2d9bd06786ee1da3b4e241d6b4ddea55e60f670337dc40ff0626: Status 404 returned error can't find the container with id 38109320a40e2d9bd06786ee1da3b4e241d6b4ddea55e60f670337dc40ff0626 Jul 29 15:01:45.574749 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.574725 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:45.811458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.811300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:45.811458 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.811364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:45.811653 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.811476 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.811653 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.811502 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.811653 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.811558 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.81154071 +0000 UTC m=+3.018303445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:45.811653 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.811575 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.811568559 +0000 UTC m=+3.018331267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:45.912516 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:45.912483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:45.912686 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.912656 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:45.912686 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.912682 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:45.912775 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.912696 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:45.912775 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:45.912756 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:46.912738502 +0000 UTC m=+3.119501226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.015946 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.015910 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:46.183254 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.183119 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:45 +0000 UTC" deadline="2028-03-23 12:38:18.847788102 +0000 UTC" Jul 29 15:01:46.183254 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.183183 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14469h36m32.664610923s" Jul 29 15:01:46.311477 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.310934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:46.311477 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.311096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:46.313314 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.313255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" event={"ID":"3843e12b-7039-4974-88a8-a850cad2bdbd","Type":"ContainerStarted","Data":"8293a5fbecbb67f40f1e7a95dfb87ed200912c3c1f84fdea8738550863bff2df"} Jul 29 15:01:46.315803 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.315734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" event={"ID":"afe1a7c4734bb08de9989144eeaa56b2","Type":"ContainerStarted","Data":"d4ca4b9e918b4d777b707075d22a63b88724447281569a24f3a090e1e7fdf7cc"} Jul 29 15:01:46.319965 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.319939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfvf2" event={"ID":"99aa0c42-14e4-4267-be04-9d7a4e2e0096","Type":"ContainerStarted","Data":"38109320a40e2d9bd06786ee1da3b4e241d6b4ddea55e60f670337dc40ff0626"} Jul 29 15:01:46.323108 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.323073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"e27ef329e880e9e5576f06edd0dee55534e6f0a3b6222e0e78bcb1aacb34a943"} Jul 29 15:01:46.325844 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.325817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fq6vl" event={"ID":"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3","Type":"ContainerStarted","Data":"6fdb306ffff2483c6eb10a44de67c21f7f45e98e6a0bb24918e70d49f644b69d"} Jul 29 15:01:46.329780 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.329727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n29qb" event={"ID":"93c25b1d-01be-41b4-9981-bfbcfc4a15d9","Type":"ContainerStarted","Data":"f37d9b45b917442fb4747e46b94cd9c7689c0c630ed3c22a4c33123fe7aec115"} Jul 29 15:01:46.340529 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.340500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrrhj" event={"ID":"893997c6-be51-4a60-9394-8d135ca6bbbb","Type":"ContainerStarted","Data":"0bd7589a62cf00a38bfde320a578738e219c9cdf3414f3a92f12bb4baf099966"} Jul 29 15:01:46.343659 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.343631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2jfn" event={"ID":"09b7ba2b-9a63-49eb-bff8-5da0ce48528e","Type":"ContainerStarted","Data":"1921cefdf53328df492f588879a82fee4faa28fe19024e47912058e1b1e27c5b"} Jul 29 15:01:46.354167 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.354138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerStarted","Data":"a28ddbf9ef8d107a1ce1d7621ab65ae5cc9299c6c1965f7dbcc19fc98576cf84"} Jul 29 15:01:46.365587 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.364651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" event={"ID":"ed97c7e1ca27213276dd4347a4081684","Type":"ContainerStarted","Data":"8b0af0d6e65c871bd2daba55ff7f1af634603a8f1f40506624e6cdaf52749e21"} Jul 29 15:01:46.376439 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.376400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" event={"ID":"ab8cb8a0-48c2-4730-a94b-86be1b14025d","Type":"ContainerStarted","Data":"fcecef9aef0b731235827c2fa69be4ddd43dee0c8d584d3697aa3a1c967abc2d"} Jul 29 15:01:46.819252 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.819043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:46.819252 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.819104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:46.819525 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.819288 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.819525 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.819358 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:48.819336614 +0000 UTC m=+5.026099325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:46.819854 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.819748 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.819854 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.819818 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:48.819801445 +0000 UTC m=+5.026564172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:46.919863 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:46.919821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:46.920067 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.920039 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:46.920067 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.920061 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:46.920216 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.920075 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:46.920216 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:46.920141 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:48.920121616 +0000 UTC m=+5.126884331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:47.184037 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:47.183947 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 14:56:45 +0000 UTC" deadline="2028-04-04 09:23:33.851155423 +0000 UTC" Jul 29 15:01:47.184037 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:47.183988 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14754h21m46.667172117s" Jul 29 15:01:47.305045 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:47.305009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:47.305298 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:47.305151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:47.305670 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:47.305646 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:47.305792 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:47.305767 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:48.171232 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:48.171196 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 15:01:48.304438 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:48.304402 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:48.304911 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.304561 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:48.837639 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:48.837578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:48.837639 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:48.837634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:48.837894 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.837770 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:48.837894 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.837809 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:48.837894 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.837857 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:01:52.83783304 +0000 UTC m=+9.044595768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:48.837894 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.837879 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:52.837868646 +0000 UTC m=+9.044631356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:48.938554 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:48.938511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:48.938719 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.938701 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:48.938762 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.938723 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:48.938762 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.938736 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:48.938828 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:48.938803 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:01:52.938781537 +0000 UTC m=+9.145544249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:49.304524 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:49.304432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:49.304995 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:49.304567 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:49.304995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:49.304970 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:49.305170 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:49.305060 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:50.307394 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:50.307363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:50.307916 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:50.307516 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:51.304221 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:51.304189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:51.304420 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:51.304346 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:51.304750 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:51.304719 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:51.304925 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:51.304873 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:52.306250 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:52.304218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:52.306250 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.304366 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:52.873975 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:52.873940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:52.874169 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:52.873987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:52.874169 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.874109 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:52.874169 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.874157 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:00.874143371 +0000 UTC m=+17.080906083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:01:52.874667 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.874581 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:52.874667 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.874635 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:00.87461692 +0000 UTC m=+17.081379645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:01:52.974384 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:52.974344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:52.974574 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.974533 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:01:52.974574 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.974555 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:01:52.974574 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.974568 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:52.974729 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:52.974631 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:00.974609419 +0000 UTC m=+17.181372152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:01:53.305070 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:53.304976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:53.305279 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:53.305102 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:53.305588 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:53.305567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:53.305738 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:53.305702 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:54.308217 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:54.307956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:54.308217 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:54.308094 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:55.304551 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:55.304514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:55.304724 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:55.304645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:55.305047 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:55.305021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:55.305191 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:55.305116 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:56.304050 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:56.304012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:56.304545 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:56.304137 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:57.304841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:57.304807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:57.305308 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:57.304933 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:57.305308 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:57.304992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:57.305308 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:57.305096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:01:58.304186 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:58.304137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:01:58.304728 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:58.304691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:01:59.304857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:59.304824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:01:59.305314 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:01:59.304829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:01:59.305314 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:59.304953 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:01:59.305314 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:01:59.304975 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:00.304328 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:00.304287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:00.304522 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:00.304429 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:00.932685 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:00.932645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:00.933041 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:00.932720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:00.933041 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:00.932800 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:00.933041 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:00.932805 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:00.933041 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:00.932854 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:16.932840895 +0000 UTC m=+33.139603604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:00.933041 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:00.932867 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:16.932860325 +0000 UTC m=+33.139623033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:01.033589 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:01.033551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:01.033743 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.033673 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:01.033743 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.033687 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:01.033743 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.033696 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.033838 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.033739 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:17.033726882 +0000 UTC m=+33.240489590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:01.304059 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:01.303936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:01.304059 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:01.303943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:01.304180 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.304070 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:01.304227 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:01.304176 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:02.304846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:02.304811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:02.305327 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:02.304962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:03.304232 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:03.304018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:03.304421 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:03.304018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:03.304421 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:03.304327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:03.304516 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:03.304418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:04.307375 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:04.307342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:04.307759 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:04.307451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:05.304180 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:05.304125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:05.304339 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:05.304125 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:05.304339 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:05.304260 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:05.304411 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:05.304367 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:06.303962 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:06.303937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:06.304393 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:06.304039 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:06.479553 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:06.479509 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" podStartSLOduration=21.479495171 podStartE2EDuration="21.479495171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:06.479229683 +0000 UTC m=+22.685992413" watchObservedRunningTime="2026-07-29 15:02:06.479495171 +0000 UTC m=+22.686257900" Jul 29 15:02:07.304572 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.304330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:07.305249 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.304397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:07.305249 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:07.304631 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:07.305249 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:07.304700 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:07.466887 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.466850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"f945e22427638fd290bf6b40fbb6ae7ff2e3169f772ee24f314a40e6d930e0e5"} Jul 29 15:02:07.467088 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.466940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"b51b6df0a8379f60fba86713fb6a0d90e5f83012c29acc3e6468644c54f19cd4"} Jul 29 15:02:07.467088 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.466987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"a76082344a720c24e14370e8723bf0562d56f7222a2e65f782d255e6e0927227"} Jul 29 15:02:07.467088 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.467039 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"9a440d982ca83124ee86793e0028cc76a9c33ae7d3bb2197869b631f0970997e"} Jul 29 15:02:07.467088 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.467080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"7935600b85c67419bd2ba31ade5f0a244bc6799d1e88df408561f53c99a0dd0d"} Jul 29 15:02:07.467311 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.467124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"22e57bb1ab96d70da8d443770334018897c25fab66571bb53d118fc8790bb398"} Jul 29 15:02:07.468940 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.468906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n29qb" event={"ID":"93c25b1d-01be-41b4-9981-bfbcfc4a15d9","Type":"ContainerStarted","Data":"2b69b882d6a9cbc5e5c0ccd88d8e18cbaf28d1c6b06ecb100d92d63a00b197ff"} Jul 29 15:02:07.471734 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.471708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrrhj" event={"ID":"893997c6-be51-4a60-9394-8d135ca6bbbb","Type":"ContainerStarted","Data":"d9a2a3bfa18d7e32ce8767bda5fa2f8eb0b0537823f4680624f4debf04e9f909"} Jul 29 15:02:07.473258 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.473233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2jfn" event={"ID":"09b7ba2b-9a63-49eb-bff8-5da0ce48528e","Type":"ContainerStarted","Data":"e2d74fc56077e44ad4f8190ed94a814385273197859b5a6b65e39c4c04a87272"} Jul 29 15:02:07.474843 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.474818 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="74b800a396751b9260439be0b639f51d1e3fd73135bdd6c7d4752805d60c5156" exitCode=0 Jul 29 15:02:07.474938 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.474888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"74b800a396751b9260439be0b639f51d1e3fd73135bdd6c7d4752805d60c5156"} Jul 29 15:02:07.476698 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.476645 2562 generic.go:356] "Generic (PLEG): container finished" podID="ed97c7e1ca27213276dd4347a4081684" containerID="988644b0c790456e460b3c350ea03c5a5da5d7376511d7a31f7232e28316222d" exitCode=0 Jul 29 15:02:07.476698 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.476667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" event={"ID":"ed97c7e1ca27213276dd4347a4081684","Type":"ContainerDied","Data":"988644b0c790456e460b3c350ea03c5a5da5d7376511d7a31f7232e28316222d"} Jul 29 15:02:07.478263 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.478243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" event={"ID":"ab8cb8a0-48c2-4730-a94b-86be1b14025d","Type":"ContainerStarted","Data":"d73b1338d80dc5d2c3a6b9134e3bab0d73a84c2b23e7e776c90c5cf89a773f49"} Jul 29 15:02:07.480116 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.480085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" event={"ID":"3843e12b-7039-4974-88a8-a850cad2bdbd","Type":"ContainerStarted","Data":"a24c390c459b0e62a68de5ae0896e704ce545a2149039c693af7bb0a9a24c531"} Jul 29 15:02:07.482175 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.481628 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-151.ec2.internal" event={"ID":"afe1a7c4734bb08de9989144eeaa56b2","Type":"ContainerStarted","Data":"1661e4446ea79552ffc26bd3ff7c76522aeb757957ba7ed23bb81122b661412a"} Jul 29 15:02:07.485035 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.484996 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfvf2" event={"ID":"99aa0c42-14e4-4267-be04-9d7a4e2e0096","Type":"ContainerStarted","Data":"73ace95996e96355a87a2757b12b7b6ed31cf3fef5a1985210ceb0cb9f96f96f"} Jul 29 15:02:07.527580 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.527538 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n29qb" podStartSLOduration=2.093184805 podStartE2EDuration="22.527524187s" totalImagesPullingTime="20.434339382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.498260629 +0000 UTC m=+23.705023358" watchObservedRunningTime="2026-07-29 15:02:07.527524187 +0000 UTC m=+23.734286916" Jul 29 15:02:07.580576 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.580488 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c2jfn" podStartSLOduration=1.758301458 podStartE2EDuration="22.580473628s" totalImagesPullingTime="20.82217217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.580375968 +0000 UTC m=+23.787138698" watchObservedRunningTime="2026-07-29 15:02:07.580473628 +0000 UTC m=+23.787236385" Jul 29 15:02:07.602900 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.602851 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jrrhj" podStartSLOduration=1.786577136 podStartE2EDuration="22.602835515s" totalImagesPullingTime="20.816258379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.602653619 +0000 UTC m=+23.809416348" watchObservedRunningTime="2026-07-29 15:02:07.602835515 +0000 UTC m=+23.809598245" Jul 29 15:02:07.630126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.630083 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vn4s9" podStartSLOduration=1.940490664 podStartE2EDuration="22.630068168s" totalImagesPullingTime="20.689577504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.623433319 +0000 UTC m=+23.830196049" watchObservedRunningTime="2026-07-29 15:02:07.630068168 +0000 UTC m=+23.836830897" Jul 29 15:02:07.852307 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.852075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:07.923968 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:07.923942 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 15:02:08.170177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.170027 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T15:02:07.923965606Z","UUID":"c712fcbf-e23c-43d6-be3e-0dc33acda781","Handler":null,"Name":"","Endpoint":""} Jul 29 15:02:08.172158 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.172122 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 15:02:08.172286 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.172175 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 15:02:08.304445 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.304415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:08.304699 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:08.304558 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:08.490536 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.490443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" event={"ID":"ed97c7e1ca27213276dd4347a4081684","Type":"ContainerStarted","Data":"638b15be4cffa20bd313ce3c0d98e2b24a671c8ae6213272078599c5b87a68c7"} Jul 29 15:02:08.494037 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.493997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" event={"ID":"3843e12b-7039-4974-88a8-a850cad2bdbd","Type":"ContainerStarted","Data":"64d3859442bba7fa2c9cb22a4a354dfd102187a28997557962cb26a3e740abb7"} Jul 29 15:02:08.495867 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.495837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fq6vl" event={"ID":"4bb1c00e-bf26-4a47-b47d-ce69153e0ac3","Type":"ContainerStarted","Data":"ddc987224bdd411ec559a6537bbe5b005c304218ab2d53f9ccb4b0251bcd64d3"} Jul 29 15:02:08.514227 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.514184 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gfvf2" podStartSLOduration=2.785358714 podStartE2EDuration="23.514167702s" totalImagesPullingTime="20.728808988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:07.644212704 +0000 UTC m=+23.850975435" watchObservedRunningTime="2026-07-29 15:02:08.514167702 +0000 UTC m=+24.720930432" Jul 29 15:02:08.539172 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.539089 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-151.ec2.internal" podStartSLOduration=23.539069919 podStartE2EDuration="23.539069919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:08.515478614 +0000 UTC m=+24.722241345" watchObservedRunningTime="2026-07-29 15:02:08.539069919 +0000 UTC m=+24.745832648" Jul 29 15:02:08.554897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.554861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:08.797962 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.797885 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:02:08.798490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.798466 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:02:08.815569 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:08.815527 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fq6vl" podStartSLOduration=3.086103171 podStartE2EDuration="23.815514483s" totalImagesPullingTime="20.729411312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:08.538990309 +0000 UTC m=+24.745753039" watchObservedRunningTime="2026-07-29 15:02:08.815514483 +0000 UTC m=+25.022277269" Jul 29 15:02:09.213726 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.213691 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:09.304114 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.304088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:09.304276 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:09.304213 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:09.304276 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.304265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:09.304393 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:09.304371 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:09.315720 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.315680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:09.502157 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.502101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"bd5acb1e89fac7e303e52c845137bc076d88096daa732443c6ce47ec377a57a0"} Jul 29 15:02:09.504566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.504541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" event={"ID":"3843e12b-7039-4974-88a8-a850cad2bdbd","Type":"ContainerStarted","Data":"7c94479b6204ef3af3d24fd2b51405dd2a711a442b3c0d73e54649edc348dc6d"} Jul 29 15:02:09.505400 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.505379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:02:09.505825 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.505804 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jrrhj" Jul 29 15:02:09.525756 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.525712 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dc4dt" podStartSLOduration=1.557317722 podStartE2EDuration="24.525695693s" totalImagesPullingTime="22.968377971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:09.525578131 +0000 UTC m=+25.732340862" watchObservedRunningTime="2026-07-29 15:02:09.525695693 +0000 UTC m=+25.732458425" Jul 29 15:02:09.593305 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:09.593228 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:10.304245 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:10.304210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:10.304431 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:10.304360 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:11.304604 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:11.304569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:11.305095 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:11.304568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:11.305095 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:11.304696 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:11.305095 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:11.304790 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:12.305268 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.305069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:12.305796 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:12.305355 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:12.514565 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.514474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" event={"ID":"84287bc9-df3c-49f9-94a8-87beff5dbf4a","Type":"ContainerStarted","Data":"6e85c40189120d93c0c51283ffdf34196af1c8d37343e51aa05e3d22df8c89e6"} Jul 29 15:02:12.514777 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.514742 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:12.514841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.514819 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:12.514897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.514871 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:12.517229 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.517198 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="8de900809a5634be9f8dce9177dfec68be3974ffe27fd3c71a8b6c87ec3f7635" exitCode=0 Jul 29 15:02:12.517371 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.517256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"8de900809a5634be9f8dce9177dfec68be3974ffe27fd3c71a8b6c87ec3f7635"} Jul 29 15:02:12.531521 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.531494 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:12.531736 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.531722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:12.548313 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:12.548268 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" podStartSLOduration=6.608377041 podStartE2EDuration="27.548253577s" totalImagesPullingTime="20.939876536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:12.54667588 +0000 UTC m=+28.753438610" watchObservedRunningTime="2026-07-29 15:02:12.548253577 +0000 UTC m=+28.755016306" Jul 29 15:02:13.304099 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.304056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:13.304355 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:13.304172 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:13.304355 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.304230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:13.304355 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:13.304321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:13.750906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.750658 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bv4x"] Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.750954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75jqd"] Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.751036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.751058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:13.751165 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:13.751241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:13.751476 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.751435 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lhch"] Jul 29 15:02:13.751836 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:13.751511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:13.751836 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:13.751589 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:14.524351 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:14.524304 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="2709711ecda68d5c4d7a55745a0c1148b5bdc793e3fbcb15f00abd7502558439" exitCode=0 Jul 29 15:02:14.524542 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:14.524383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"2709711ecda68d5c4d7a55745a0c1148b5bdc793e3fbcb15f00abd7502558439"} Jul 29 15:02:15.304236 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:15.304197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:15.304236 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:15.304242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:15.304704 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:15.304306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:15.304704 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:15.304316 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:15.304704 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:15.304374 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:15.304704 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:15.304441 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:16.531137 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:16.531039 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="d541f8f23b166835d1855b0818466dee97734102da6c85d6c0560604df5938b2" exitCode=0 Jul 29 15:02:16.531137 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:16.531087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"d541f8f23b166835d1855b0818466dee97734102da6c85d6c0560604df5938b2"} Jul 29 15:02:16.943455 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:16.943374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:16.943455 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:16.943415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:16.943640 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:16.943521 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:16.943640 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:16.943530 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:16.943640 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:16.943587 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs podName:031d0230-5940-4209-8211-f60cb3c2986f nodeName:}" failed. No retries permitted until 2026-07-29 15:02:48.943571685 +0000 UTC m=+65.150334393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs") pod "network-metrics-daemon-4lhch" (UID: "031d0230-5940-4209-8211-f60cb3c2986f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 15:02:16.943640 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:16.943602 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret podName:a4620880-af96-4b41-b6fc-2bf2e816aaa7 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:48.943595729 +0000 UTC m=+65.150358437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret") pod "global-pull-secret-syncer-5bv4x" (UID: "a4620880-af96-4b41-b6fc-2bf2e816aaa7") : object "kube-system"/"original-pull-secret" not registered Jul 29 15:02:17.044105 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:17.044074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:17.044277 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.044215 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 15:02:17.044277 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.044230 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 15:02:17.044277 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.044238 2562 projected.go:196] Error preparing data for projected volume kube-api-access-928vr for pod openshift-network-diagnostics/network-check-target-75jqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:17.044371 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.044288 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr podName:cc886772-62b8-4927-a3a4-f0c18d79a370 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:49.044275247 +0000 UTC m=+65.251037956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-928vr" (UniqueName: "kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr") pod "network-check-target-75jqd" (UID: "cc886772-62b8-4927-a3a4-f0c18d79a370") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:17.304748 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:17.304773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:17.304901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.304895 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75jqd" podUID="cc886772-62b8-4927-a3a4-f0c18d79a370" Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.305032 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lhch" podUID="031d0230-5940-4209-8211-f60cb3c2986f" Jul 29 15:02:17.305253 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:17.305127 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bv4x" podUID="a4620880-af96-4b41-b6fc-2bf2e816aaa7" Jul 29 15:02:17.909972 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:17.909890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:18.055871 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:18.055834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:19.163272 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.163182 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-151.ec2.internal" event="NodeReady" Jul 29 15:02:19.163624 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.163324 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 15:02:19.212940 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.212898 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c8f8d78d8-4h599"] Jul 29 15:02:19.215262 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.215235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.218082 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.218060 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 15:02:19.218082 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.218077 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 15:02:19.218293 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.218215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 15:02:19.218370 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.218351 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zkfwv\"" Jul 29 15:02:19.227514 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.227495 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 15:02:19.231891 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.231752 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c8f8d78d8-4h599"] Jul 29 15:02:19.239816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.239790 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hq5k4"] Jul 29 15:02:19.241773 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.241752 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dpzgn"] Jul 29 15:02:19.241892 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.241852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.243855 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.243828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.244391 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.244373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 15:02:19.244595 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.244569 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kscqp\"" Jul 29 15:02:19.244913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.244897 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 15:02:19.244998 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.244951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 15:02:19.247567 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.247546 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 15:02:19.248070 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.248051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 15:02:19.248434 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.248414 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzscc\"" Jul 29 15:02:19.256205 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.256183 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hq5k4"] Jul 29 15:02:19.260622 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.260602 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dpzgn"] Jul 29 15:02:19.304350 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.304315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:19.304781 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.304762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:19.305168 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.305132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:19.307266 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.307235 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:19.309841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.309823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dwvq\"" Jul 29 15:02:19.310013 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.309999 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ws96\"" Jul 29 15:02:19.310093 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.310018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:02:19.311067 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.310862 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:19.311810 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.311788 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:02:19.364370 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgz54\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xp6c\" (UniqueName: \"kubernetes.io/projected/f7b3b145-39f4-48f2-93ec-cadd89885d1b-kube-api-access-6xp6c\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czl4s\" (UniqueName: \"kubernetes.io/projected/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-kube-api-access-czl4s\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.364791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7b3b145-39f4-48f2-93ec-cadd89885d1b-cert\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.364791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-config-volume\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.364791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364951 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364951 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.364951 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.364862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-tmp-dir\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.465700 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-config-volume\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.465700 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.465930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.465930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.465930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.465930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.465927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-tmp-dir\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.465957 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.465972 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.466043 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:19.96602425 +0000 UTC m=+36.172786981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz54\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.466126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.466490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xp6c\" (UniqueName: \"kubernetes.io/projected/f7b3b145-39f4-48f2-93ec-cadd89885d1b-kube-api-access-6xp6c\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.466490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.466490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czl4s\" (UniqueName: \"kubernetes.io/projected/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-kube-api-access-czl4s\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.466490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7b3b145-39f4-48f2-93ec-cadd89885d1b-cert\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.466490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466389 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-config-volume\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.466711 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.466547 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:19.466711 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.466620 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:19.966600254 +0000 UTC m=+36.173362976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:19.466816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-tmp-dir\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.466909 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.466887 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.467226 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.467066 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.467226 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.467171 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.474897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.470504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.474897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.470549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7b3b145-39f4-48f2-93ec-cadd89885d1b-cert\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.474897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.471476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.477700 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.477665 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.478995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.478962 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xp6c\" (UniqueName: \"kubernetes.io/projected/f7b3b145-39f4-48f2-93ec-cadd89885d1b-kube-api-access-6xp6c\") pod \"ingress-canary-hq5k4\" (UID: \"f7b3b145-39f4-48f2-93ec-cadd89885d1b\") " pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.479261 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.479242 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czl4s\" (UniqueName: \"kubernetes.io/projected/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-kube-api-access-czl4s\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.480293 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.480269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgz54\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.544937 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.544899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:19.553685 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.553662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hq5k4" Jul 29 15:02:19.970795 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.970760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:19.971001 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:19.970833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:19.971001 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.970932 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:19.971001 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.970978 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:19.971001 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.970994 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:19.971201 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.971022 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:20.970998815 +0000 UTC m=+37.177761728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:19.971201 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:19.971039 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:20.971029094 +0000 UTC m=+37.177791826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:20.777906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:20.777880 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hq5k4"] Jul 29 15:02:20.781814 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:20.781785 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b3b145_39f4_48f2_93ec_cadd89885d1b.slice/crio-eb2de9761821a988aa0899cbe773207fe4440da047da4740b057f530bdc2ee26 WatchSource:0}: Error finding container eb2de9761821a988aa0899cbe773207fe4440da047da4740b057f530bdc2ee26: Status 404 returned error can't find the container with id eb2de9761821a988aa0899cbe773207fe4440da047da4740b057f530bdc2ee26 Jul 29 15:02:20.980478 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:20.980434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:20.980601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:20.980507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:20.980601 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:20.980592 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:20.980664 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:20.980657 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:22.980636223 +0000 UTC m=+39.187398951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:20.980702 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:20.980594 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:20.980750 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:20.980701 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:20.980779 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:20.980752 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:22.980738518 +0000 UTC m=+39.187501228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:21.552265 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:21.552227 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="abc8d20b9086fbfc6afa6216aaf06215b9ab9cd2700850b77beb307b1cb0b75c" exitCode=0 Jul 29 15:02:21.552456 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:21.552290 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"abc8d20b9086fbfc6afa6216aaf06215b9ab9cd2700850b77beb307b1cb0b75c"} Jul 29 15:02:21.553557 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:21.553532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hq5k4" event={"ID":"f7b3b145-39f4-48f2-93ec-cadd89885d1b","Type":"ContainerStarted","Data":"eb2de9761821a988aa0899cbe773207fe4440da047da4740b057f530bdc2ee26"} Jul 29 15:02:22.385700 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.385443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:22.477405 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.477362 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:22.559749 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.559714 2562 generic.go:356] "Generic (PLEG): container finished" podID="eefb86b4-c29f-4d91-bdf2-431cfe31a4bf" containerID="6d4b522819086841a9310c5193850f86320df8f4fab4c00ecfe0ac57ca95d385" exitCode=0 Jul 29 15:02:22.559906 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.559777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerDied","Data":"6d4b522819086841a9310c5193850f86320df8f4fab4c00ecfe0ac57ca95d385"} Jul 29 15:02:22.998859 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.998824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:22.999040 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:22.998882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:22.999040 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:22.999002 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:22.999040 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:22.998999 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:22.999040 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:22.999013 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:22.999193 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:22.999069 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.999054269 +0000 UTC m=+43.205816977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:22.999193 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:22.999085 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.999079193 +0000 UTC m=+43.205841900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:23.003628 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.003598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.105634 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.105603 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.540000 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.539978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.565995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.565968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qp766" event={"ID":"eefb86b4-c29f-4d91-bdf2-431cfe31a4bf","Type":"ContainerStarted","Data":"fb72225544421825d174af11898eb2877039180370da7e76d0f67709f8150916"} Jul 29 15:02:23.567507 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.567483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hq5k4" event={"ID":"f7b3b145-39f4-48f2-93ec-cadd89885d1b","Type":"ContainerStarted","Data":"a9a98978a3cc666519e3ce95e0a17258f877db6810637281aa85bef010e28d85"} Jul 29 15:02:23.592739 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.592683 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qp766" podStartSLOduration=6.75346463 podStartE2EDuration="38.592668688s" totalImagesPullingTime="31.839204058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:23.5911234 +0000 UTC m=+39.797886129" watchObservedRunningTime="2026-07-29 15:02:23.592668688 +0000 UTC m=+39.799431447" Jul 29 15:02:23.608527 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.608479 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hq5k4" podStartSLOduration=1.977661711 podStartE2EDuration="4.608462967s" totalImagesPullingTime="2.630801256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:23.608115412 +0000 UTC m=+39.814878158" watchObservedRunningTime="2026-07-29 15:02:23.608462967 +0000 UTC m=+39.815225732" Jul 29 15:02:23.703268 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.703187 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.774379 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.774332 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.859201 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.859130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:23.968875 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:23.968843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:24.038050 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.038018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:24.435633 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.435556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cctgz"] Jul 29 15:02:24.455981 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.455952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.458498 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.458470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cctgz"] Jul 29 15:02:24.458922 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.458729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k86cr\"" Jul 29 15:02:24.465880 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.465860 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 15:02:24.466155 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.466122 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 15:02:24.466269 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.466217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 15:02:24.466362 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.466348 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 15:02:24.494040 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.494013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:24.590015 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.589983 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:24.611957 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.611924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmtg\" (UniqueName: \"kubernetes.io/projected/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-api-access-5wmtg\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.612044 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.611964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.612044 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.611991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7a1f276-4ece-410d-8688-bbddd57bfad0-crio-socket\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.612137 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.612111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7a1f276-4ece-410d-8688-bbddd57bfad0-data-volume\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.612216 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.612135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmtg\" (UniqueName: \"kubernetes.io/projected/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-api-access-5wmtg\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7a1f276-4ece-410d-8688-bbddd57bfad0-crio-socket\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713809 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:24.713704 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:24.713809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7a1f276-4ece-410d-8688-bbddd57bfad0-data-volume\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.713809 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:24.713787 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:25.213767727 +0000 UTC m=+41.420530452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : configmap "kube-rbac-proxy" not found Jul 29 15:02:24.714076 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:24.713836 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:24.714076 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:24.713879 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:25.213864071 +0000 UTC m=+41.420626794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:24.714076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.713909 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7a1f276-4ece-410d-8688-bbddd57bfad0-crio-socket\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.714210 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.714115 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7a1f276-4ece-410d-8688-bbddd57bfad0-data-volume\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.722603 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.722576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:24.725760 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.725738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmtg\" (UniqueName: \"kubernetes.io/projected/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-api-access-5wmtg\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:24.824949 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:24.824913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.151790 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.151757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.218153 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.218119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:25.218282 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:25.218239 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:25.218282 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.218246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:25.218341 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:25.218330 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.21831361 +0000 UTC m=+42.425076318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : configmap "kube-rbac-proxy" not found Jul 29 15:02:25.218403 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:25.218374 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:25.218436 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:25.218425 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:26.218413773 +0000 UTC m=+42.425176481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:25.252564 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.252529 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.475129 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.475094 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.545529 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.545502 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.735277 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.735202 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:25.962330 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:25.962298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:26.036188 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:26.036098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:26.220346 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:26.220318 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfvf2_99aa0c42-14e4-4267-be04-9d7a4e2e0096/dns-node-resolver/0.log" Jul 29 15:02:26.225687 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:26.225664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:26.225796 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:26.225769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:26.225862 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:26.225793 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:26.225862 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:26.225855 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:28.225835961 +0000 UTC m=+44.432598690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : configmap "kube-rbac-proxy" not found Jul 29 15:02:26.225946 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:26.225908 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:26.225983 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:26.225953 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:28.225940762 +0000 UTC m=+44.432703498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:27.031480 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:27.031438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:27.031519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:27.031599 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:27.031658 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:35.031643065 +0000 UTC m=+51.238405774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:27.031661 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:27.031679 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:27.031896 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:27.031719 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:35.031707539 +0000 UTC m=+51.238470247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:27.068629 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:27.068596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:27.169135 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:27.169103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:27.420387 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:27.420308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n29qb_93c25b1d-01be-41b4-9981-bfbcfc4a15d9/node-ca/0.log" Jul 29 15:02:28.213276 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:28.213241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:28.242484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:28.242455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:28.242591 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:28.242513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:28.242591 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:28.242584 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:28.242667 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:28.242603 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:28.242667 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:28.242635 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:32.242622349 +0000 UTC m=+48.449385056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : configmap "kube-rbac-proxy" not found Jul 29 15:02:28.242667 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:28.242652 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:32.242639897 +0000 UTC m=+48.449402604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:28.422154 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:28.422121 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hq5k4_f7b3b145-39f4-48f2-93ec-cadd89885d1b/serve-healthcheck-canary/0.log" Jul 29 15:02:31.869628 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:31.869594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:32.105094 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.105055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:32.273066 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.273030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:32.273254 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.273136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:32.273254 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:32.273177 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 15:02:32.273329 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:32.273257 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:40.273241562 +0000 UTC m=+56.480004269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : configmap "kube-rbac-proxy" not found Jul 29 15:02:32.273329 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:32.273283 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:32.273400 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:32.273349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:40.273335649 +0000 UTC m=+56.480098358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:32.300507 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.300473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:32.548202 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.548105 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:32.819667 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:32.819588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:33.390081 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:33.390047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:33.972862 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:33.972833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:34.174871 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:34.174842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:34.562750 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:34.562716 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:34.800351 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:34.800320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:35.093021 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:35.092984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") pod \"image-registry-5c8f8d78d8-4h599\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:35.093216 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:35.093071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:35.093216 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:35.093129 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 15:02:35.093216 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:35.093166 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c8f8d78d8-4h599: secret "image-registry-tls" not found Jul 29 15:02:35.093216 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:35.093181 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 15:02:35.093350 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:35.093231 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls podName:2c43ad9f-010c-49ff-94f6-45f5f74bb509 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:51.093215872 +0000 UTC m=+67.299978580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls") pod "image-registry-5c8f8d78d8-4h599" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509") : secret "image-registry-tls" not found Jul 29 15:02:35.093350 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:35.093245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls podName:cf7247a8-e3d7-4262-95bd-61d624b0fd1d nodeName:}" failed. No retries permitted until 2026-07-29 15:02:51.093239607 +0000 UTC m=+67.300002315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls") pod "dns-default-dpzgn" (UID: "cf7247a8-e3d7-4262-95bd-61d624b0fd1d") : secret "dns-default-metrics-tls" not found Jul 29 15:02:35.207570 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:35.207536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:35.618259 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:35.618223 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:35.771820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:35.771784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:36.158696 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:36.158663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:36.256132 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:36.256096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:36.768482 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:36.768452 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:37.066759 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:37.066673 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:37.197125 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:37.197086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:37.564091 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:37.564057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:37.662555 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:37.662521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:37.968768 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:37.968729 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:38.575803 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:38.575771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:38.961658 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:38.961552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:39.376808 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:39.376759 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:39.511973 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:39.511931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:40.337417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.337377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:40.337593 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.337440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:40.338370 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:40.337827 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 15:02:40.338370 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:40.337926 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls podName:e7a1f276-4ece-410d-8688-bbddd57bfad0 nodeName:}" failed. No retries permitted until 2026-07-29 15:02:56.337904077 +0000 UTC m=+72.544666789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cctgz" (UID: "e7a1f276-4ece-410d-8688-bbddd57bfad0") : secret "insights-runtime-extractor-tls" not found Jul 29 15:02:40.338566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.338533 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7a1f276-4ece-410d-8688-bbddd57bfad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:40.437651 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.437617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:40.568584 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.568552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:40.669842 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.669736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:40.773043 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.773009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:40.956782 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:40.956682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:41.349323 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:41.349275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:41.566383 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:41.566325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:42.174548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:42.174508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:42.364090 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:42.364050 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:42.569791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:42.569749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:43.422916 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:43.422844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:43.531946 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:43.531905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:44.542729 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:44.542697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nt92p" Jul 29 15:02:48.616441 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.616410 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c8f8d78d8-4h599"] Jul 29 15:02:48.616814 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:02:48.616589 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" podUID="2c43ad9f-010c-49ff-94f6-45f5f74bb509" Jul 29 15:02:48.624351 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.624321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:48.630359 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.630338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:48.675527 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.675492 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8687978b4d-82t4p"] Jul 29 15:02:48.677102 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.677088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.695915 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.695883 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8687978b4d-82t4p"] Jul 29 15:02:48.699104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699085 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.699235 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699130 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.699235 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699185 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.699235 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699212 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.699593 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699567 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:02:48.699786 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699626 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgz54\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.699932 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.699910 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.700062 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700046 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration\") pod \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\" (UID: \"2c43ad9f-010c-49ff-94f6-45f5f74bb509\") " Jul 29 15:02:48.700274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700131 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:02:48.700274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700238 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:02:48.700504 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700476 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:48.700601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-tls\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-image-registry-private-configuration\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700682 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-trusted-ca\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700682 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-bound-sa-token\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e10c7bc-fb72-443d-9c0c-64c804e0696f-ca-trust-extracted\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700770 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-installation-pull-secrets\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phspf\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-kube-api-access-phspf\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700897 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-certificates\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.700941 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700930 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-certificates\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.700987 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700946 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c43ad9f-010c-49ff-94f6-45f5f74bb509-trusted-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.700987 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.700961 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c43ad9f-010c-49ff-94f6-45f5f74bb509-ca-trust-extracted\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.701657 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.701635 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:02:48.701958 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.701935 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:02:48.702039 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.702008 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54" (OuterVolumeSpecName: "kube-api-access-kgz54") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "kube-api-access-kgz54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:02:48.702382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.702367 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c43ad9f-010c-49ff-94f6-45f5f74bb509" (UID: "2c43ad9f-010c-49ff-94f6-45f5f74bb509"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:02:48.801814 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-certificates\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.801814 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-tls\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-image-registry-private-configuration\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-trusted-ca\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-bound-sa-token\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e10c7bc-fb72-443d-9c0c-64c804e0696f-ca-trust-extracted\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.801986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-installation-pull-secrets\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phspf\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-kube-api-access-phspf\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802401 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802299 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-bound-sa-token\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.802401 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802321 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgz54\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-kube-api-access-kgz54\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.802401 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802337 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-image-registry-private-configuration\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.802401 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802352 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c43ad9f-010c-49ff-94f6-45f5f74bb509-installation-pull-secrets\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:48.802832 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802739 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e10c7bc-fb72-443d-9c0c-64c804e0696f-ca-trust-extracted\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-trusted-ca\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.802950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.802907 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-certificates\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.804603 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.804575 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-image-registry-private-configuration\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.804706 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.804628 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e10c7bc-fb72-443d-9c0c-64c804e0696f-installation-pull-secrets\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.804706 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.804633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-registry-tls\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.811761 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.811734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-bound-sa-token\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.812525 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.812500 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phspf\" (UniqueName: \"kubernetes.io/projected/1e10c7bc-fb72-443d-9c0c-64c804e0696f-kube-api-access-phspf\") pod \"image-registry-8687978b4d-82t4p\" (UID: \"1e10c7bc-fb72-443d-9c0c-64c804e0696f\") " pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:48.813228 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.813206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:48.912051 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.911958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:48.991714 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.991685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zkfwv\"" Jul 29 15:02:48.996999 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:48.996981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:49.003779 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.003755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:49.003878 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.003823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:49.006064 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.006047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 15:02:49.006451 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.006364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 15:02:49.008382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.008363 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:49.016538 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.016509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4620880-af96-4b41-b6fc-2bf2e816aaa7-original-pull-secret\") pod \"global-pull-secret-syncer-5bv4x\" (UID: \"a4620880-af96-4b41-b6fc-2bf2e816aaa7\") " pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:49.016665 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.016518 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/031d0230-5940-4209-8211-f60cb3c2986f-metrics-certs\") pod \"network-metrics-daemon-4lhch\" (UID: \"031d0230-5940-4209-8211-f60cb3c2986f\") " pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:49.024523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.024505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bv4x" Jul 29 15:02:49.033088 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.033048 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dwvq\"" Jul 29 15:02:49.041594 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.041573 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lhch" Jul 29 15:02:49.110175 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.104307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:49.110175 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.107280 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 15:02:49.118424 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.118291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:49.118590 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.118573 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 15:02:49.130575 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.129305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-928vr\" (UniqueName: \"kubernetes.io/projected/cc886772-62b8-4927-a3a4-f0c18d79a370-kube-api-access-928vr\") pod \"network-check-target-75jqd\" (UID: \"cc886772-62b8-4927-a3a4-f0c18d79a370\") " pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:49.174803 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.174726 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8687978b4d-82t4p"] Jul 29 15:02:49.177998 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:49.177971 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e10c7bc_fb72_443d_9c0c_64c804e0696f.slice/crio-2ae55a8b3c74d303145034453148b8339ab164ef648500d363e1a97bc33c6bd9 WatchSource:0}: Error finding container 2ae55a8b3c74d303145034453148b8339ab164ef648500d363e1a97bc33c6bd9: Status 404 returned error can't find the container with id 2ae55a8b3c74d303145034453148b8339ab164ef648500d363e1a97bc33c6bd9 Jul 29 15:02:49.188361 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.188335 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bv4x"] Jul 29 15:02:49.191596 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:49.191572 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4620880_af96_4b41_b6fc_2bf2e816aaa7.slice/crio-f370975e567aa7aaa623982188ac8bd2165fc68cecd723be6ff102cf1cd30107 WatchSource:0}: Error finding container f370975e567aa7aaa623982188ac8bd2165fc68cecd723be6ff102cf1cd30107: Status 404 returned error can't find the container with id f370975e567aa7aaa623982188ac8bd2165fc68cecd723be6ff102cf1cd30107 Jul 29 15:02:49.205537 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.205508 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lhch"] Jul 29 15:02:49.210239 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:49.210200 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031d0230_5940_4209_8211_f60cb3c2986f.slice/crio-00920a0aff8cc1c6c63f4ba280fa99b72c48efd5b45effe54dc3325f58c7bb3b WatchSource:0}: Error finding container 00920a0aff8cc1c6c63f4ba280fa99b72c48efd5b45effe54dc3325f58c7bb3b: Status 404 returned error can't find the container with id 00920a0aff8cc1c6c63f4ba280fa99b72c48efd5b45effe54dc3325f58c7bb3b Jul 29 15:02:49.320050 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.320024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ws96\"" Jul 29 15:02:49.327272 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.327252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:49.457987 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.457921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75jqd"] Jul 29 15:02:49.461547 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:49.461527 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc886772_62b8_4927_a3a4_f0c18d79a370.slice/crio-785d4a5e951ed897a9ba1f6d17f6267b85dd56714c016285411a81e962aef1c4 WatchSource:0}: Error finding container 785d4a5e951ed897a9ba1f6d17f6267b85dd56714c016285411a81e962aef1c4: Status 404 returned error can't find the container with id 785d4a5e951ed897a9ba1f6d17f6267b85dd56714c016285411a81e962aef1c4 Jul 29 15:02:49.629980 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.629933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" event={"ID":"1e10c7bc-fb72-443d-9c0c-64c804e0696f","Type":"ContainerStarted","Data":"a850fbdeb9d715731ecdcc2d9a9c65de2c453a70244c7ed7d90b2cf6fbf8daff"} Jul 29 15:02:49.630432 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.629995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" event={"ID":"1e10c7bc-fb72-443d-9c0c-64c804e0696f","Type":"ContainerStarted","Data":"2ae55a8b3c74d303145034453148b8339ab164ef648500d363e1a97bc33c6bd9"} Jul 29 15:02:49.630647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.630624 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:02:49.632643 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.632603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75jqd" event={"ID":"cc886772-62b8-4927-a3a4-f0c18d79a370","Type":"ContainerStarted","Data":"785d4a5e951ed897a9ba1f6d17f6267b85dd56714c016285411a81e962aef1c4"} Jul 29 15:02:49.634009 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.633984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lhch" event={"ID":"031d0230-5940-4209-8211-f60cb3c2986f","Type":"ContainerStarted","Data":"00920a0aff8cc1c6c63f4ba280fa99b72c48efd5b45effe54dc3325f58c7bb3b"} Jul 29 15:02:49.635518 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.635485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bv4x" event={"ID":"a4620880-af96-4b41-b6fc-2bf2e816aaa7","Type":"ContainerStarted","Data":"f370975e567aa7aaa623982188ac8bd2165fc68cecd723be6ff102cf1cd30107"} Jul 29 15:02:49.635608 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.635515 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c8f8d78d8-4h599" Jul 29 15:02:49.653554 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.653498 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" podStartSLOduration=1.653477278 podStartE2EDuration="1.653477278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:49.651036506 +0000 UTC m=+65.857799238" watchObservedRunningTime="2026-07-29 15:02:49.653477278 +0000 UTC m=+65.860240011" Jul 29 15:02:49.681599 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.681540 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c8f8d78d8-4h599"] Jul 29 15:02:49.685799 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.685769 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c8f8d78d8-4h599"] Jul 29 15:02:49.709198 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:49.708451 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c43ad9f-010c-49ff-94f6-45f5f74bb509-registry-tls\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:02:50.310289 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.310258 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c43ad9f-010c-49ff-94f6-45f5f74bb509" path="/var/lib/kubelet/pods/2c43ad9f-010c-49ff-94f6-45f5f74bb509/volumes" Jul 29 15:02:50.644085 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.644043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lhch" event={"ID":"031d0230-5940-4209-8211-f60cb3c2986f","Type":"ContainerStarted","Data":"c40876fd881810aa58a80c50274fc8b5e42eaf5585b54c843b3f1027013e6b64"} Jul 29 15:02:50.644536 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.644137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lhch" event={"ID":"031d0230-5940-4209-8211-f60cb3c2986f","Type":"ContainerStarted","Data":"258d4db4c4d6047881b1b3f1e9ab003cb93a9543c597d9dc522e37c52750361f"} Jul 29 15:02:50.666232 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.666172 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4lhch" podStartSLOduration=64.704583013 podStartE2EDuration="1m5.666133502s" totalImagesPullingTime="961.550489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:50.665456755 +0000 UTC m=+66.872219487" watchObservedRunningTime="2026-07-29 15:02:50.666133502 +0000 UTC m=+66.872896232" Jul 29 15:02:50.787717 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.787675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:50.871492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:50.871455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:51.121442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.121395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:51.130934 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.130866 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf7247a8-e3d7-4262-95bd-61d624b0fd1d-metrics-tls\") pod \"dns-default-dpzgn\" (UID: \"cf7247a8-e3d7-4262-95bd-61d624b0fd1d\") " pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:51.363756 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.363719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzscc\"" Jul 29 15:02:51.371961 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.371876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:51.543747 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.543718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dpzgn"] Jul 29 15:02:51.547510 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:51.547477 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7247a8_e3d7_4262_95bd_61d624b0fd1d.slice/crio-fb5ef9511586ffb48269866721d05d240e579bbb0f7c2aefae439d6005f17e59 WatchSource:0}: Error finding container fb5ef9511586ffb48269866721d05d240e579bbb0f7c2aefae439d6005f17e59: Status 404 returned error can't find the container with id fb5ef9511586ffb48269866721d05d240e579bbb0f7c2aefae439d6005f17e59 Jul 29 15:02:51.649126 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:51.649035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dpzgn" event={"ID":"cf7247a8-e3d7-4262-95bd-61d624b0fd1d","Type":"ContainerStarted","Data":"fb5ef9511586ffb48269866721d05d240e579bbb0f7c2aefae439d6005f17e59"} Jul 29 15:02:52.163904 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.163865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:52.267344 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.267308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:52.361619 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.361564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:52.482769 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.482740 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:52.561611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.561578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:52.734380 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:52.734269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:54.661086 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:54.661046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75jqd" event={"ID":"cc886772-62b8-4927-a3a4-f0c18d79a370","Type":"ContainerStarted","Data":"48b58a21ac4cda3b7d6b937bc50cef507ca5800e15cd7cbe62a93858fa132464"} Jul 29 15:02:54.661642 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:54.661192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:02:54.662847 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:54.662822 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bv4x" event={"ID":"a4620880-af96-4b41-b6fc-2bf2e816aaa7","Type":"ContainerStarted","Data":"eccf080571a35e691562823ea965510559eadfe463691f6f0b49bff402dcf617"} Jul 29 15:02:54.680934 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:54.680887 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-75jqd" podStartSLOduration=64.952316121 podStartE2EDuration="1m9.680872345s" totalImagesPullingTime="4.728556224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:54.680428186 +0000 UTC m=+70.887190916" watchObservedRunningTime="2026-07-29 15:02:54.680872345 +0000 UTC m=+70.887635076" Jul 29 15:02:54.701175 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:54.701101 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5bv4x" podStartSLOduration=64.698088262 podStartE2EDuration="1m9.701081126s" totalImagesPullingTime="5.002992864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:54.699457991 +0000 UTC m=+70.906220721" watchObservedRunningTime="2026-07-29 15:02:54.701081126 +0000 UTC m=+70.907843857" Jul 29 15:02:55.667891 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:55.667800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dpzgn" event={"ID":"cf7247a8-e3d7-4262-95bd-61d624b0fd1d","Type":"ContainerStarted","Data":"fe0569a16e3edb6817e6f58f76180ed39aa148a15c75f8e9b5c1df1929fce562"} Jul 29 15:02:55.667891 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:55.667858 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dpzgn" event={"ID":"cf7247a8-e3d7-4262-95bd-61d624b0fd1d","Type":"ContainerStarted","Data":"2feaa51348a564c110ab66071f4ee2e9466e64e6e75aa606bc48da666a30d175"} Jul 29 15:02:55.687767 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:55.687711 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dpzgn" podStartSLOduration=32.925491082 podStartE2EDuration="36.687695749s" totalImagesPullingTime="3.762204667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:02:55.687414986 +0000 UTC m=+71.894177716" watchObservedRunningTime="2026-07-29 15:02:55.687695749 +0000 UTC m=+71.894458480" Jul 29 15:02:56.364160 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.364102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:56.366596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.366575 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7a1f276-4ece-410d-8688-bbddd57bfad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cctgz\" (UID: \"e7a1f276-4ece-410d-8688-bbddd57bfad0\") " pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:56.569218 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.569181 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k86cr\"" Jul 29 15:02:56.576388 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.576368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cctgz" Jul 29 15:02:56.672182 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.672137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dpzgn" Jul 29 15:02:56.710581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:56.710530 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cctgz"] Jul 29 15:02:56.714832 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:02:56.714797 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a1f276_4ece_410d_8688_bbddd57bfad0.slice/crio-4461412357df5d17c7643a27a0383c3e6d8583cd5eda6c33d8ef0efae9d45062 WatchSource:0}: Error finding container 4461412357df5d17c7643a27a0383c3e6d8583cd5eda6c33d8ef0efae9d45062: Status 404 returned error can't find the container with id 4461412357df5d17c7643a27a0383c3e6d8583cd5eda6c33d8ef0efae9d45062 Jul 29 15:02:57.359679 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:57.359646 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:57.461334 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:57.461241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:57.654857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:57.654731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:57.678489 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:57.678458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cctgz" event={"ID":"e7a1f276-4ece-410d-8688-bbddd57bfad0","Type":"ContainerStarted","Data":"4461412357df5d17c7643a27a0383c3e6d8583cd5eda6c33d8ef0efae9d45062"} Jul 29 15:02:58.764866 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:58.764824 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:58.855597 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:58.855557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:02:59.443262 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:02:59.443209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:01.675619 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:01.675590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:01.952731 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:01.952640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:02.153171 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.153116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:02.213461 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.213380 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq"] Jul 29 15:03:02.216438 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.216420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.221203 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.221177 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 15:03:02.221203 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.221193 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 15:03:02.221386 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.221177 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 15:03:02.221858 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.221842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 15:03:02.221988 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.221971 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kmckt\"" Jul 29 15:03:02.222057 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.222018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 15:03:02.248339 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.248308 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xn9s7"] Jul 29 15:03:02.251950 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.251921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq"] Jul 29 15:03:02.252083 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.252069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.256854 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.256822 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 15:03:02.264119 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.264094 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-68ttx\"" Jul 29 15:03:02.273751 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.273724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 15:03:02.275375 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.275352 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 15:03:02.279744 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.279715 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9"] Jul 29 15:03:02.282957 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.282935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.286034 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.286008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j5t4q\"" Jul 29 15:03:02.286277 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.286259 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 15:03:02.286409 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.286389 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 15:03:02.291869 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.291846 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 15:03:02.308932 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.308896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31be1938-0a63-4fa7-8df5-e8d03c23f512-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.308950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.308980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-root\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-textfile\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-metrics-client-ca\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tx4w\" (UniqueName: \"kubernetes.io/projected/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-api-access-2tx4w\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-tls\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-wtmp\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.309417 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smcr\" (UniqueName: \"kubernetes.io/projected/feb12150-8984-4f1c-a1f7-36cb8fa03281-kube-api-access-7smcr\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb12150-8984-4f1c-a1f7-36cb8fa03281-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-sys\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.309638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.309600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7lv7\" (UniqueName: \"kubernetes.io/projected/6760182f-5500-493d-9081-c9c1e7ca85f4-kube-api-access-g7lv7\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.310797 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.310724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9"] Jul 29 15:03:02.376029 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.375995 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:02.410486 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-tls\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-wtmp\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.410684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.410990 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smcr\" (UniqueName: \"kubernetes.io/projected/feb12150-8984-4f1c-a1f7-36cb8fa03281-kube-api-access-7smcr\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.410990 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb12150-8984-4f1c-a1f7-36cb8fa03281-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.410990 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-sys\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.410990 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410768 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-wtmp\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.410990 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.410835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-sys\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411372 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411453 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.411453 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7lv7\" (UniqueName: \"kubernetes.io/projected/6760182f-5500-493d-9081-c9c1e7ca85f4-kube-api-access-g7lv7\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411453 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31be1938-0a63-4fa7-8df5-e8d03c23f512-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.411596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.411596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411498 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.411596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-root\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-textfile\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-metrics-client-ca\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411829 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tx4w\" (UniqueName: \"kubernetes.io/projected/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-api-access-2tx4w\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.411901 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.411969 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.411951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6760182f-5500-493d-9081-c9c1e7ca85f4-root\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.412166 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.412127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-textfile\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.412252 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.412173 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.412491 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.412462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/31be1938-0a63-4fa7-8df5-e8d03c23f512-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.412581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.412511 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760182f-5500-493d-9081-c9c1e7ca85f4-metrics-client-ca\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.413177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.413128 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb12150-8984-4f1c-a1f7-36cb8fa03281-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.414082 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.414056 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.414647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.414599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.415306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.414812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb12150-8984-4f1c-a1f7-36cb8fa03281-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.415306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.415269 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.415733 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.415711 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-tls\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.416242 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.416219 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760182f-5500-493d-9081-c9c1e7ca85f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.430930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.430901 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7lv7\" (UniqueName: \"kubernetes.io/projected/6760182f-5500-493d-9081-c9c1e7ca85f4-kube-api-access-g7lv7\") pod \"node-exporter-xn9s7\" (UID: \"6760182f-5500-493d-9081-c9c1e7ca85f4\") " pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.431122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.430999 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smcr\" (UniqueName: \"kubernetes.io/projected/feb12150-8984-4f1c-a1f7-36cb8fa03281-kube-api-access-7smcr\") pod \"openshift-state-metrics-b8f49f5c6-528nq\" (UID: \"feb12150-8984-4f1c-a1f7-36cb8fa03281\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.431331 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.431315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tx4w\" (UniqueName: \"kubernetes.io/projected/31be1938-0a63-4fa7-8df5-e8d03c23f512-kube-api-access-2tx4w\") pod \"kube-state-metrics-56d9f944b4-5xmv9\" (UID: \"31be1938-0a63-4fa7-8df5-e8d03c23f512\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.502042 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.502005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:02.525683 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.525644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" Jul 29 15:03:02.562653 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.562614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xn9s7" Jul 29 15:03:02.577810 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:02.577768 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6760182f_5500_493d_9081_c9c1e7ca85f4.slice/crio-5512783ce0a51c0d31317344436701c938c0a078e8777e966fc70b041d2bb8d9 WatchSource:0}: Error finding container 5512783ce0a51c0d31317344436701c938c0a078e8777e966fc70b041d2bb8d9: Status 404 returned error can't find the container with id 5512783ce0a51c0d31317344436701c938c0a078e8777e966fc70b041d2bb8d9 Jul 29 15:03:02.594520 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.594482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" Jul 29 15:03:02.648689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.648623 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:02.697614 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.697583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cctgz" event={"ID":"e7a1f276-4ece-410d-8688-bbddd57bfad0","Type":"ContainerStarted","Data":"3e0b79199de9737d9050e14b29024f8c452afe98f891ab72f56c24d5dedf18a3"} Jul 29 15:03:02.699820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.699786 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xn9s7" event={"ID":"6760182f-5500-493d-9081-c9c1e7ca85f4","Type":"ContainerStarted","Data":"5512783ce0a51c0d31317344436701c938c0a078e8777e966fc70b041d2bb8d9"} Jul 29 15:03:02.725822 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.725788 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq"] Jul 29 15:03:02.727221 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:02.727188 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb12150_8984_4f1c_a1f7_36cb8fa03281.slice/crio-32b5c4595b3597d4d636e73977f443c20fa10f818c0450813f450ca11dfa274c WatchSource:0}: Error finding container 32b5c4595b3597d4d636e73977f443c20fa10f818c0450813f450ca11dfa274c: Status 404 returned error can't find the container with id 32b5c4595b3597d4d636e73977f443c20fa10f818c0450813f450ca11dfa274c Jul 29 15:03:02.787765 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:02.787735 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9"] Jul 29 15:03:02.791001 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:02.790972 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31be1938_0a63_4fa7_8df5_e8d03c23f512.slice/crio-e4397841bd1fc10212ef239681dde1ebee28ee92e00804afa0fcf5540e8db504 WatchSource:0}: Error finding container e4397841bd1fc10212ef239681dde1ebee28ee92e00804afa0fcf5540e8db504: Status 404 returned error can't find the container with id e4397841bd1fc10212ef239681dde1ebee28ee92e00804afa0fcf5540e8db504 Jul 29 15:03:03.110250 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.110160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:03.305920 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.305890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:03.318490 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.318451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:03:03.323696 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.323660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.326437 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.326403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.327482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.327658 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.327764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:03:03.328174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:03:03.328423 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328327 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vwn9v\"" Jul 29 15:03:03.328423 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:03:03.328423 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.328333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:03:03.360102 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.360066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:03:03.419188 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419188 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419188 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419459 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419767 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419467 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.419767 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.419501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqqbf\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.489917 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.489881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:03.520893 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.520839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.520893 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.520892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.520923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.520970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.520998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqqbf\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.521442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.521288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.522283 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.522256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.524340 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.524318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.524451 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:03.524418 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 15:03:03.524509 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:03.524478 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls podName:27a31d96-faa5-4a6e-b4be-4c36b372b320 nodeName:}" failed. No retries permitted until 2026-07-29 15:03:04.024458596 +0000 UTC m=+80.231221318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320") : secret "alertmanager-main-tls" not found Jul 29 15:03:03.526006 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.525460 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.527021 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.526976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.534762 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.534738 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.536554 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.536509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.536656 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.536571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.536864 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.536835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.536952 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.536914 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.539583 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.539527 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.540758 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.540735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.542095 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.542045 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqqbf\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:03.706482 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.706392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" event={"ID":"31be1938-0a63-4fa7-8df5-e8d03c23f512","Type":"ContainerStarted","Data":"e4397841bd1fc10212ef239681dde1ebee28ee92e00804afa0fcf5540e8db504"} Jul 29 15:03:03.708841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.708696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" event={"ID":"feb12150-8984-4f1c-a1f7-36cb8fa03281","Type":"ContainerStarted","Data":"ff1b021273bf65057a8d44e3436f4e5e8bfd699b1f9abad0a229bd071a123a14"} Jul 29 15:03:03.708841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.708766 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" event={"ID":"feb12150-8984-4f1c-a1f7-36cb8fa03281","Type":"ContainerStarted","Data":"610d94cf897f910ddc78e823e3ac5c5f0a7abda889bed8d5123f420a39ed4f61"} Jul 29 15:03:03.708841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:03.708796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" event={"ID":"feb12150-8984-4f1c-a1f7-36cb8fa03281","Type":"ContainerStarted","Data":"32b5c4595b3597d4d636e73977f443c20fa10f818c0450813f450ca11dfa274c"} Jul 29 15:03:04.026573 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:04.026541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:04.026758 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:04.026694 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 15:03:04.026758 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:04.026755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls podName:27a31d96-faa5-4a6e-b4be-4c36b372b320 nodeName:}" failed. No retries permitted until 2026-07-29 15:03:05.026740521 +0000 UTC m=+81.233503230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320") : secret "alertmanager-main-tls" not found Jul 29 15:03:04.269314 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:04.269279 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:04.699023 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:04.698978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:04.789850 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:04.789802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:05.036479 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.036438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:05.039191 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.039159 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:05.136505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.136465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:03:05.220199 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.220132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:05.329615 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.329536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:05.565321 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.565284 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:05.761647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.761604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:05.861759 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:05.861725 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:06.430305 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.430217 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:03:06.463676 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:06.463635 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a31d96_faa5_4a6e_b4be_4c36b372b320.slice/crio-5add2755b5a14a6220ebcbfaeb9fc66faf1e948712fa090e55deea52a00fa83c WatchSource:0}: Error finding container 5add2755b5a14a6220ebcbfaeb9fc66faf1e948712fa090e55deea52a00fa83c: Status 404 returned error can't find the container with id 5add2755b5a14a6220ebcbfaeb9fc66faf1e948712fa090e55deea52a00fa83c Jul 29 15:03:06.681105 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.681029 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dpzgn" Jul 29 15:03:06.723870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.723833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"5add2755b5a14a6220ebcbfaeb9fc66faf1e948712fa090e55deea52a00fa83c"} Jul 29 15:03:06.726196 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.726129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cctgz" event={"ID":"e7a1f276-4ece-410d-8688-bbddd57bfad0","Type":"ContainerStarted","Data":"67e3446918817be5fa3753166307c9a4c154c68d0ceb99d1c83ac0c8b89e4dfa"} Jul 29 15:03:06.728717 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.728687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" event={"ID":"31be1938-0a63-4fa7-8df5-e8d03c23f512","Type":"ContainerStarted","Data":"e345386a9bcd7d53470b58d0daf60bdc0d1b298ed4d322047102aabb61d88bc1"} Jul 29 15:03:06.728820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.728744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" event={"ID":"31be1938-0a63-4fa7-8df5-e8d03c23f512","Type":"ContainerStarted","Data":"16155adaada7f4a1c05e565451d32616285af3c1bbafc7508faf9bf16ece2fab"} Jul 29 15:03:06.728820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.728773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" event={"ID":"31be1938-0a63-4fa7-8df5-e8d03c23f512","Type":"ContainerStarted","Data":"56cc42f814b7594ceaea8d2db6a48ba01abea60b953a0049fe792394c1f7b2ed"} Jul 29 15:03:06.731231 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.731207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" event={"ID":"feb12150-8984-4f1c-a1f7-36cb8fa03281","Type":"ContainerStarted","Data":"a22ad91af1cfa69bc9a9686d18b10372dab9d37b5ce8d96bbb3152c4856c993d"} Jul 29 15:03:06.737922 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.733878 2562 generic.go:356] "Generic (PLEG): container finished" podID="6760182f-5500-493d-9081-c9c1e7ca85f4" containerID="a7734bf3b854db0ea8c61e1dbb565f62fb39c8f5a156512d982eb88fc2e851da" exitCode=0 Jul 29 15:03:06.737922 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.733917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xn9s7" event={"ID":"6760182f-5500-493d-9081-c9c1e7ca85f4","Type":"ContainerDied","Data":"a7734bf3b854db0ea8c61e1dbb565f62fb39c8f5a156512d982eb88fc2e851da"} Jul 29 15:03:06.767894 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.767866 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-skksd"] Jul 29 15:03:06.768250 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.768201 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-5xmv9" podStartSLOduration=1.35478309 podStartE2EDuration="4.76818147s" totalImagesPullingTime="3.41339838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:06.76578388 +0000 UTC m=+82.972546611" watchObservedRunningTime="2026-07-29 15:03:06.76818147 +0000 UTC m=+82.974944202" Jul 29 15:03:06.770755 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.770717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:06.772742 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.772725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.780226 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.780040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vn9v4\"" Jul 29 15:03:06.780585 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.780561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 15:03:06.806057 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.806028 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79c8cf7795-knmng"] Jul 29 15:03:06.810257 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.810235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-skksd"] Jul 29 15:03:06.810387 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.810327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.812801 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.812781 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n8nsr\"" Jul 29 15:03:06.813091 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.813075 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 15:03:06.813175 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.813123 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 15:03:06.813312 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.813294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cjqja6i7u6uh0\"" Jul 29 15:03:06.813563 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.813544 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 15:03:06.813760 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.813745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 15:03:06.824765 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.824717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79c8cf7795-knmng"] Jul 29 15:03:06.846513 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.846472 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-528nq" podStartSLOduration=1.503816064 podStartE2EDuration="4.846457379s" totalImagesPullingTime="3.342641315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:06.844391981 +0000 UTC m=+83.051154713" watchObservedRunningTime="2026-07-29 15:03:06.846457379 +0000 UTC m=+83.053220109" Jul 29 15:03:06.850904 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.850880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-tls\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.851056 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzp8s\" (UniqueName: \"kubernetes.io/projected/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-kube-api-access-kzp8s\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-audit-log\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-metrics-server-audit-profiles\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-client-certs\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-client-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851438 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcqb\" (UniqueName: \"kubernetes.io/projected/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-kube-api-access-xjcqb\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.852225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.851502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.897201 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.897118 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.952861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcqb\" (UniqueName: \"kubernetes.io/projected/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-kube-api-access-xjcqb\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.952918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.952960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-tls\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzp8s\" (UniqueName: \"kubernetes.io/projected/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-kube-api-access-kzp8s\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-audit-log\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-metrics-server-audit-profiles\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-client-certs\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-client-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.953272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.954709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.954751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-metrics-server-audit-profiles\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.955104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.955038 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-audit-log\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.958309 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.958257 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-client-certs\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.958532 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.958509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.959600 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.959566 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-client-ca-bundle\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.960004 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.959970 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-secret-metrics-server-tls\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:06.963977 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.963950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzp8s\" (UniqueName: \"kubernetes.io/projected/224c5bcc-dd8c-4537-8f5d-cf40420e2ca8-kube-api-access-kzp8s\") pod \"monitoring-plugin-68b7fc9574-skksd\" (UID: \"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:06.964529 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:06.964510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcqb\" (UniqueName: \"kubernetes.io/projected/6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd-kube-api-access-xjcqb\") pod \"metrics-server-79c8cf7795-knmng\" (UID: \"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd\") " pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:07.102702 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.100356 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:07.124762 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.124729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:07.286491 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.286461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-skksd"] Jul 29 15:03:07.305742 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.305714 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79c8cf7795-knmng"] Jul 29 15:03:07.518605 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:07.518569 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224c5bcc_dd8c_4537_8f5d_cf40420e2ca8.slice/crio-c4fe661e1cb99ff0a195c7ce84c8dd94061ff39c1bb4b5770715ed7ef672c7c9 WatchSource:0}: Error finding container c4fe661e1cb99ff0a195c7ce84c8dd94061ff39c1bb4b5770715ed7ef672c7c9: Status 404 returned error can't find the container with id c4fe661e1cb99ff0a195c7ce84c8dd94061ff39c1bb4b5770715ed7ef672c7c9 Jul 29 15:03:07.519617 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:07.519591 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb90ba7_ae9a_4583_bde9_c454c2b2dbcd.slice/crio-88bc9b67d0e4648886ba58d8e3f83b2ca2600a6cd4f557882c404b1d8f40c91b WatchSource:0}: Error finding container 88bc9b67d0e4648886ba58d8e3f83b2ca2600a6cd4f557882c404b1d8f40c91b: Status 404 returned error can't find the container with id 88bc9b67d0e4648886ba58d8e3f83b2ca2600a6cd4f557882c404b1d8f40c91b Jul 29 15:03:07.739496 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.739452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" event={"ID":"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd","Type":"ContainerStarted","Data":"88bc9b67d0e4648886ba58d8e3f83b2ca2600a6cd4f557882c404b1d8f40c91b"} Jul 29 15:03:07.740738 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.740705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" event={"ID":"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8","Type":"ContainerStarted","Data":"c4fe661e1cb99ff0a195c7ce84c8dd94061ff39c1bb4b5770715ed7ef672c7c9"} Jul 29 15:03:07.743029 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.743001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xn9s7" event={"ID":"6760182f-5500-493d-9081-c9c1e7ca85f4","Type":"ContainerStarted","Data":"88ff4e9688c90340efd9c3b0d535d7159539b0701ba19f7a0b6594cb068a7aa1"} Jul 29 15:03:07.743177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.743056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xn9s7" event={"ID":"6760182f-5500-493d-9081-c9c1e7ca85f4","Type":"ContainerStarted","Data":"cbba423f561adaf08fa8f08865cd429ab918db40529f84da340d606e84181f7d"} Jul 29 15:03:07.744782 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.744753 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf" exitCode=0 Jul 29 15:03:07.744889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.744833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf"} Jul 29 15:03:07.780867 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:07.780770 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xn9s7" podStartSLOduration=2.072732279 podStartE2EDuration="5.780753572s" totalImagesPullingTime="3.626758506s" totalInitContainerRuntime="81.262787ms" isStatefulPod=true podCreationTimestamp="2026-07-29 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:07.780636023 +0000 UTC m=+83.987398752" watchObservedRunningTime="2026-07-29 15:03:07.780753572 +0000 UTC m=+83.987516301" Jul 29 15:03:08.393822 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:08.393788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:08.673753 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:08.673645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:08.798709 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:08.798671 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:11.653442 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.653416 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8687978b4d-82t4p" Jul 29 15:03:11.763542 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.763506 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" event={"ID":"6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd","Type":"ContainerStarted","Data":"06a2dd61048747300e33286581cfc9990584a2803245d4cbe1cef0750c7b2f72"} Jul 29 15:03:11.765189 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.765131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" event={"ID":"224c5bcc-dd8c-4537-8f5d-cf40420e2ca8","Type":"ContainerStarted","Data":"d8e171798a2a4fea66d6b7d9861afad04910e5d0907cf8626e9998924c4913e1"} Jul 29 15:03:11.765333 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.765313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:11.768898 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.768855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f"} Jul 29 15:03:11.769010 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.768906 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e"} Jul 29 15:03:11.769010 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.768938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804"} Jul 29 15:03:11.769010 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.768978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7"} Jul 29 15:03:11.769010 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.769006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be"} Jul 29 15:03:11.770792 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.770766 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" Jul 29 15:03:11.770976 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.770960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cctgz" event={"ID":"e7a1f276-4ece-410d-8688-bbddd57bfad0","Type":"ContainerStarted","Data":"658e900e8ea1501287266c591bda47c34bed6a5ba271fa4270948d2cb0be25ab"} Jul 29 15:03:11.791709 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.791664 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" podStartSLOduration=1.8039986099999998 podStartE2EDuration="5.791648568s" totalImagesPullingTime="3.987649958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.79132034 +0000 UTC m=+87.998083070" watchObservedRunningTime="2026-07-29 15:03:11.791648568 +0000 UTC m=+87.998411298" Jul 29 15:03:11.855424 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.855350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:11.863024 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.862976 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cctgz" podStartSLOduration=33.93147076 podStartE2EDuration="47.862961699s" totalImagesPullingTime="13.931490939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:02:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.830744722 +0000 UTC m=+88.037507452" watchObservedRunningTime="2026-07-29 15:03:11.862961699 +0000 UTC m=+88.069724428" Jul 29 15:03:11.950596 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:11.950570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:12.899015 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:12.898960 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-skksd" podStartSLOduration=3.632374164 podStartE2EDuration="6.898943413s" totalImagesPullingTime="3.266569249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:11.862609695 +0000 UTC m=+88.069372424" watchObservedRunningTime="2026-07-29 15:03:12.898943413 +0000 UTC m=+89.105706228" Jul 29 15:03:12.899406 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:12.899160 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-vvkvx"] Jul 29 15:03:12.902480 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:12.902462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:12.911375 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:12.911338 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-151.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-130-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 29 15:03:12.911375 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:12.911343 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-151.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-130-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 29 15:03:12.911375 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:12.911343 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-qv24j\" is forbidden: User \"system:node:ip-10-0-130-151.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-130-151.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"default-dockercfg-qv24j\"" type="*v1.Secret" Jul 29 15:03:12.911375 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:03:12.911342 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"downloads-7c97dc4555-vvkvx\" is forbidden: User \"system:node:ip-10-0-130-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-130-151.ec2.internal' and this object" podUID="17c5de61-6167-4f58-acbc-141eadaf22e2" pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:12.939845 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:12.939814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-vvkvx"] Jul 29 15:03:12.953846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:12.953820 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:13.010211 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.010178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsf9\" (UniqueName: \"kubernetes.io/projected/17c5de61-6167-4f58-acbc-141eadaf22e2-kube-api-access-wvsf9\") pod \"downloads-7c97dc4555-vvkvx\" (UID: \"17c5de61-6167-4f58-acbc-141eadaf22e2\") " pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:13.089651 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.089620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:13.110837 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.110811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvsf9\" (UniqueName: \"kubernetes.io/projected/17c5de61-6167-4f58-acbc-141eadaf22e2-kube-api-access-wvsf9\") pod \"downloads-7c97dc4555-vvkvx\" (UID: \"17c5de61-6167-4f58-acbc-141eadaf22e2\") " pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:13.318660 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.318483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:13.600882 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.600855 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:13.782089 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.782054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerStarted","Data":"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb"} Jul 29 15:03:13.870513 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.870403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:13.973655 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.973601 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.806133425 podStartE2EDuration="10.97358446s" totalImagesPullingTime="6.150107576s" totalInitContainerRuntime="17.343459ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:13.969691417 +0000 UTC m=+90.176454146" watchObservedRunningTime="2026-07-29 15:03:13.97358446 +0000 UTC m=+90.180347189" Jul 29 15:03:13.989042 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:13.989019 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 15:03:14.016837 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.016815 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qv24j\"" Jul 29 15:03:14.158525 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.158428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:14.485835 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.485804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:14.521511 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.521476 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 15:03:14.525040 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.525012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvsf9\" (UniqueName: \"kubernetes.io/projected/17c5de61-6167-4f58-acbc-141eadaf22e2-kube-api-access-wvsf9\") pod \"downloads-7c97dc4555-vvkvx\" (UID: \"17c5de61-6167-4f58-acbc-141eadaf22e2\") " pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:14.712592 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.712560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:14.728966 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.728936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:14.884960 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.884937 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-vvkvx"] Jul 29 15:03:14.887085 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:14.887048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c5de61_6167_4f58_acbc_141eadaf22e2.slice/crio-52225b197dd265e134c502c4e556e8e2b95630586c3df41c589dba5462faffa8 WatchSource:0}: Error finding container 52225b197dd265e134c502c4e556e8e2b95630586c3df41c589dba5462faffa8: Status 404 returned error can't find the container with id 52225b197dd265e134c502c4e556e8e2b95630586c3df41c589dba5462faffa8 Jul 29 15:03:14.893616 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:14.893591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:15.053543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:15.053439 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:15.230706 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:15.230674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:15.792430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:15.792385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-vvkvx" event={"ID":"17c5de61-6167-4f58-acbc-141eadaf22e2","Type":"ContainerStarted","Data":"52225b197dd265e134c502c4e556e8e2b95630586c3df41c589dba5462faffa8"} Jul 29 15:03:17.013891 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:17.013835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:21.230566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:21.230529 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:21.354551 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:21.354511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:22.308632 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.308599 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:22.397865 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.397830 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:22.537239 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.536306 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:03:22.543007 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.542983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.545896 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.545871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 15:03:22.546213 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.546192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 15:03:22.546821 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.546802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 15:03:22.546893 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.546844 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 15:03:22.547098 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.547073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cgxwr\"" Jul 29 15:03:22.547241 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.547182 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 15:03:22.577885 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.577817 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:03:22.692245 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8rd\" (UniqueName: \"kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.692408 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.692408 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.692492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.692492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.692584 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.692536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793578 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793578 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8rd\" (UniqueName: \"kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.793965 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.793816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.794423 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.794372 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.794563 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.794388 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.794748 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.794722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.796628 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.796602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.797337 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.797314 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.805280 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.805254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8rd\" (UniqueName: \"kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd\") pod \"console-5b8bd6c899-jgfwf\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:22.854332 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:22.854251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:23.015600 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:23.015567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:03:23.018795 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:23.018762 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda371033d_64ba_4000_bdeb_bb029d84e481.slice/crio-25787da52ed2c7f86c6f7746e05e430ff9ce8fe020dec69d98b2e877be2ef6f6 WatchSource:0}: Error finding container 25787da52ed2c7f86c6f7746e05e430ff9ce8fe020dec69d98b2e877be2ef6f6: Status 404 returned error can't find the container with id 25787da52ed2c7f86c6f7746e05e430ff9ce8fe020dec69d98b2e877be2ef6f6 Jul 29 15:03:23.598589 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:23.598557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:23.659519 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:23.659488 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:23.827712 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:23.827670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8bd6c899-jgfwf" event={"ID":"a371033d-64ba-4000-bdeb-bb029d84e481","Type":"ContainerStarted","Data":"25787da52ed2c7f86c6f7746e05e430ff9ce8fe020dec69d98b2e877be2ef6f6"} Jul 29 15:03:24.722566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:24.722521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:24.869089 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:24.869058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:24.993729 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:24.993638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:25.164045 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:25.163984 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:25.306668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:25.306592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:25.670956 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:25.670875 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-75jqd" Jul 29 15:03:27.125818 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.125774 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:27.126321 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.125858 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:27.893190 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.893136 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:03:27.902557 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.902511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:27.919485 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.919445 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:03:27.919650 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.919576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:27.933915 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:27.933893 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 15:03:28.033566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.033530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:28.040616 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040761 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040761 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnm2p\" (UniqueName: \"kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.040959 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.040882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142133 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnm2p\" (UniqueName: \"kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142931 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.142931 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.142905 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.143529 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.143455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.144001 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.143974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.145713 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.145693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.146180 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.146135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.155973 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.155947 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnm2p\" (UniqueName: \"kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p\") pod \"console-c9bbd8b65-xbn9n\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.232505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.232467 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:28.433728 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.433633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:28.530588 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:28.530550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:31.038832 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.038807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:03:31.222630 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:03:31.222588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34c7e22_f8a5_4d24_b360_9d6731a496cf.slice/crio-f8387e7e6e162a0d32a5604813161bf66855677ac1a23677d5f8c9fdb93b4d80 WatchSource:0}: Error finding container f8387e7e6e162a0d32a5604813161bf66855677ac1a23677d5f8c9fdb93b4d80: Status 404 returned error can't find the container with id f8387e7e6e162a0d32a5604813161bf66855677ac1a23677d5f8c9fdb93b4d80 Jul 29 15:03:31.867662 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.867627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9bbd8b65-xbn9n" event={"ID":"b34c7e22-f8a5-4d24-b360-9d6731a496cf","Type":"ContainerStarted","Data":"f8387e7e6e162a0d32a5604813161bf66855677ac1a23677d5f8c9fdb93b4d80"} Jul 29 15:03:31.869757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.869716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-vvkvx" event={"ID":"17c5de61-6167-4f58-acbc-141eadaf22e2","Type":"ContainerStarted","Data":"38dd529e829df2e4765dc2840cf6678a8620eecad32dc9cc1b2c737c621ed854"} Jul 29 15:03:31.870233 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.870183 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:31.888615 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.888592 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-vvkvx" Jul 29 15:03:31.903318 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:31.903257 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-vvkvx" podStartSLOduration=3.461930782 podStartE2EDuration="19.90323448s" totalImagesPullingTime="16.441303698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:31.901006604 +0000 UTC m=+108.107769335" watchObservedRunningTime="2026-07-29 15:03:31.90323448 +0000 UTC m=+108.109997211" Jul 29 15:03:35.894223 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:35.894176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8bd6c899-jgfwf" event={"ID":"a371033d-64ba-4000-bdeb-bb029d84e481","Type":"ContainerStarted","Data":"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d"} Jul 29 15:03:35.896113 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:35.896084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9bbd8b65-xbn9n" event={"ID":"b34c7e22-f8a5-4d24-b360-9d6731a496cf","Type":"ContainerStarted","Data":"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636"} Jul 29 15:03:35.931341 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:35.931281 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8bd6c899-jgfwf" podStartSLOduration=2.167531635 podStartE2EDuration="13.931259915s" totalImagesPullingTime="11.76372828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:35.928735974 +0000 UTC m=+112.135498704" watchObservedRunningTime="2026-07-29 15:03:35.931259915 +0000 UTC m=+112.138022647" Jul 29 15:03:35.974176 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:35.974104 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9bbd8b65-xbn9n" podStartSLOduration=5.420565147 podStartE2EDuration="8.974082484s" totalImagesPullingTime="3.553517337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:03:35.972719787 +0000 UTC m=+112.179482531" watchObservedRunningTime="2026-07-29 15:03:35.974082484 +0000 UTC m=+112.180845216" Jul 29 15:03:38.232857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:38.232811 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:38.233370 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:38.232905 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:38.238484 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:38.238460 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:38.914548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:38.914517 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:03:38.973019 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:38.972978 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:03:41.991721 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:41.991670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:42.086923 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:42.086890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:42.854606 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:42.854569 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:03:47.130812 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:47.130782 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:47.134877 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:47.134854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79c8cf7795-knmng" Jul 29 15:03:48.227434 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:48.227401 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:48.337465 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:48.337431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:51.490550 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:51.490515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:51.591454 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:51.591426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:52.705660 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:52.705628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:52.805795 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:52.805758 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:03:59.788922 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:03:59.788885 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:01.241215 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:01.241177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:03.999739 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:03.999694 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b8bd6c899-jgfwf" podUID="a371033d-64ba-4000-bdeb-bb029d84e481" containerName="console" containerID="cri-o://42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d" gracePeriod=15 Jul 29 15:04:04.247714 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.247690 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:04:04.359850 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359763 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.359850 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359805 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.359850 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359844 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.360123 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359862 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.360123 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359929 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx8rd\" (UniqueName: \"kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.360123 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.359960 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert\") pod \"a371033d-64ba-4000-bdeb-bb029d84e481\" (UID: \"a371033d-64ba-4000-bdeb-bb029d84e481\") " Jul 29 15:04:04.360310 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.360248 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:04.360404 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.360298 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca" (OuterVolumeSpecName: "service-ca") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:04.360404 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.360311 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config" (OuterVolumeSpecName: "console-config") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:04.362318 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.362286 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:04.362424 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.362365 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:04.362424 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.362376 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd" (OuterVolumeSpecName: "kube-api-access-jx8rd") pod "a371033d-64ba-4000-bdeb-bb029d84e481" (UID: "a371033d-64ba-4000-bdeb-bb029d84e481"). InnerVolumeSpecName "kube-api-access-jx8rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:04:04.461219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461176 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-oauth-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:04.461219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461213 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-oauth-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:04.461219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461223 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-service-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:04.461219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461232 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a371033d-64ba-4000-bdeb-bb029d84e481-console-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:04.461219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461240 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx8rd\" (UniqueName: \"kubernetes.io/projected/a371033d-64ba-4000-bdeb-bb029d84e481-kube-api-access-jx8rd\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:04.461501 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:04.461250 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a371033d-64ba-4000-bdeb-bb029d84e481-console-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:05.008080 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.008039 2562 generic.go:356] "Generic (PLEG): container finished" podID="a371033d-64ba-4000-bdeb-bb029d84e481" containerID="42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d" exitCode=0 Jul 29 15:04:05.008553 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.008086 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8bd6c899-jgfwf" Jul 29 15:04:05.008553 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.008136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8bd6c899-jgfwf" event={"ID":"a371033d-64ba-4000-bdeb-bb029d84e481","Type":"ContainerDied","Data":"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d"} Jul 29 15:04:05.008553 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.008225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8bd6c899-jgfwf" event={"ID":"a371033d-64ba-4000-bdeb-bb029d84e481","Type":"ContainerDied","Data":"25787da52ed2c7f86c6f7746e05e430ff9ce8fe020dec69d98b2e877be2ef6f6"} Jul 29 15:04:05.008553 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.008261 2562 scope.go:117] "RemoveContainer" containerID="42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d" Jul 29 15:04:05.016772 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.016752 2562 scope.go:117] "RemoveContainer" containerID="42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d" Jul 29 15:04:05.017043 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:05.017026 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d\": container with ID starting with 42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d not found: ID does not exist" containerID="42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d" Jul 29 15:04:05.017090 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.017053 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d"} err="failed to get container status \"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d\": rpc error: code = NotFound desc = could not find container \"42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d\": container with ID starting with 42fdc4119c38a5b824844bccc15fcb8f6a2e2c1faa12ae9d2ffd159fb389bc2d not found: ID does not exist" Jul 29 15:04:05.030024 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.029993 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:04:05.036894 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:05.036868 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8bd6c899-jgfwf"] Jul 29 15:04:06.308818 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:06.308784 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a371033d-64ba-4000-bdeb-bb029d84e481" path="/var/lib/kubelet/pods/a371033d-64ba-4000-bdeb-bb029d84e481/volumes" Jul 29 15:04:08.686471 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:08.686437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:10.116820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:10.116783 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:22.647046 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647006 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:22.647493 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647340 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="alertmanager" containerID="cri-o://689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be" gracePeriod=120 Jul 29 15:04:22.647493 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647402 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-metric" containerID="cri-o://427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f" gracePeriod=120 Jul 29 15:04:22.647493 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647456 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy" containerID="cri-o://b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e" gracePeriod=120 Jul 29 15:04:22.647493 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647461 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-web" containerID="cri-o://b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804" gracePeriod=120 Jul 29 15:04:22.647699 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647421 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="prom-label-proxy" containerID="cri-o://5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb" gracePeriod=120 Jul 29 15:04:22.648555 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:22.647750 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="config-reloader" containerID="cri-o://3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7" gracePeriod=120 Jul 29 15:04:23.076222 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076191 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb" exitCode=0 Jul 29 15:04:23.076222 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076217 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f" exitCode=0 Jul 29 15:04:23.076222 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076223 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e" exitCode=0 Jul 29 15:04:23.076222 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076229 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7" exitCode=0 Jul 29 15:04:23.076222 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076234 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be" exitCode=0 Jul 29 15:04:23.076523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb"} Jul 29 15:04:23.076523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f"} Jul 29 15:04:23.076523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e"} Jul 29 15:04:23.076523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7"} Jul 29 15:04:23.076523 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.076411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be"} Jul 29 15:04:23.393903 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.393821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:23.461822 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.461787 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:23.929241 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:23.929210 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.009753 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009759 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009791 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009811 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009831 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009868 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.009944 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009923 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.009974 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010008 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqqbf\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010036 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010070 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010094 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010174 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"27a31d96-faa5-4a6e-b4be-4c36b372b320\" (UID: \"27a31d96-faa5-4a6e-b4be-4c36b372b320\") " Jul 29 15:04:24.010306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:24.010666 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010504 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.010890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.010860 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:04:24.011367 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.011063 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:04:24.013511 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.013471 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:04:24.013848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.013789 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.013933 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.013860 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.014105 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.014076 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.015103 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.015077 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.015434 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.015132 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf" (OuterVolumeSpecName: "kube-api-access-zqqbf") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "kube-api-access-zqqbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:04:24.015560 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.015536 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume" (OuterVolumeSpecName: "config-volume") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.015619 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.015603 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out" (OuterVolumeSpecName: "config-out") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:04:24.017996 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.017980 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.025595 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.025508 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config" (OuterVolumeSpecName: "web-config") pod "27a31d96-faa5-4a6e-b4be-4c36b372b320" (UID: "27a31d96-faa5-4a6e-b4be-4c36b372b320"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:04:24.083540 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.083502 2562 generic.go:356] "Generic (PLEG): container finished" podID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerID="b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804" exitCode=0 Jul 29 15:04:24.083730 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.083578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804"} Jul 29 15:04:24.083730 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.083595 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.083730 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.083643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27a31d96-faa5-4a6e-b4be-4c36b372b320","Type":"ContainerDied","Data":"5add2755b5a14a6220ebcbfaeb9fc66faf1e948712fa090e55deea52a00fa83c"} Jul 29 15:04:24.083730 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.083676 2562 scope.go:117] "RemoveContainer" containerID="5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb" Jul 29 15:04:24.091293 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.091273 2562 scope.go:117] "RemoveContainer" containerID="427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f" Jul 29 15:04:24.098288 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.098272 2562 scope.go:117] "RemoveContainer" containerID="b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e" Jul 29 15:04:24.104833 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.104817 2562 scope.go:117] "RemoveContainer" containerID="b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804" Jul 29 15:04:24.111020 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.110994 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111168 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111120 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-cluster-tls-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111185 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111197 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-main-tls\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111209 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-alertmanager-main-db\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111221 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-tls-assets\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111237 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-volume\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111250 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqqbf\" (UniqueName: \"kubernetes.io/projected/27a31d96-faa5-4a6e-b4be-4c36b372b320-kube-api-access-zqqbf\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111263 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a31d96-faa5-4a6e-b4be-4c36b372b320-metrics-client-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111274 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111275 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-web-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111287 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a31d96-faa5-4a6e-b4be-4c36b372b320-config-out\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.111581 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.111300 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27a31d96-faa5-4a6e-b4be-4c36b372b320-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:04:24.112047 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.112027 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:24.112306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.112290 2562 scope.go:117] "RemoveContainer" containerID="3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7" Jul 29 15:04:24.119646 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.119629 2562 scope.go:117] "RemoveContainer" containerID="689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be" Jul 29 15:04:24.120456 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.120439 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:24.127976 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.127956 2562 scope.go:117] "RemoveContainer" containerID="0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf" Jul 29 15:04:24.135024 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135007 2562 scope.go:117] "RemoveContainer" containerID="5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb" Jul 29 15:04:24.135294 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.135276 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb\": container with ID starting with 5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb not found: ID does not exist" containerID="5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb" Jul 29 15:04:24.135345 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135301 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb"} err="failed to get container status \"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb\": rpc error: code = NotFound desc = could not find container \"5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb\": container with ID starting with 5275c2b3f7882b14bafa22e1dfb2a026449597c5575de67aea44465bfeaec8bb not found: ID does not exist" Jul 29 15:04:24.135345 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135319 2562 scope.go:117] "RemoveContainer" containerID="427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f" Jul 29 15:04:24.135532 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.135513 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f\": container with ID starting with 427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f not found: ID does not exist" containerID="427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f" Jul 29 15:04:24.135578 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135538 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f"} err="failed to get container status \"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f\": rpc error: code = NotFound desc = could not find container \"427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f\": container with ID starting with 427519c2d6e8dfc01be8f885a2621c77d9965af5361ce9f216b7d196ee6af94f not found: ID does not exist" Jul 29 15:04:24.135578 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135552 2562 scope.go:117] "RemoveContainer" containerID="b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e" Jul 29 15:04:24.135767 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.135748 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e\": container with ID starting with b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e not found: ID does not exist" containerID="b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e" Jul 29 15:04:24.135820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135772 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e"} err="failed to get container status \"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e\": rpc error: code = NotFound desc = could not find container \"b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e\": container with ID starting with b4cdda55ce91649fbdced7e757d412ccca78bd6ef28c29623b8dc42af4a4021e not found: ID does not exist" Jul 29 15:04:24.135820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135786 2562 scope.go:117] "RemoveContainer" containerID="b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804" Jul 29 15:04:24.135978 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.135961 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804\": container with ID starting with b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804 not found: ID does not exist" containerID="b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804" Jul 29 15:04:24.136017 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135981 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804"} err="failed to get container status \"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804\": rpc error: code = NotFound desc = could not find container \"b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804\": container with ID starting with b2992f1869cc5a8a10aac28634e0b28a6b1c7c353c70ce9589669ae4829bd804 not found: ID does not exist" Jul 29 15:04:24.136017 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.135993 2562 scope.go:117] "RemoveContainer" containerID="3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7" Jul 29 15:04:24.136214 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.136200 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7\": container with ID starting with 3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7 not found: ID does not exist" containerID="3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7" Jul 29 15:04:24.136270 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.136218 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7"} err="failed to get container status \"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7\": rpc error: code = NotFound desc = could not find container \"3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7\": container with ID starting with 3065d88dab2a5b3e0fe33087b26911307da2dff436ff7480d443586e8d2fd3e7 not found: ID does not exist" Jul 29 15:04:24.136270 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.136229 2562 scope.go:117] "RemoveContainer" containerID="689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be" Jul 29 15:04:24.136445 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.136430 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be\": container with ID starting with 689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be not found: ID does not exist" containerID="689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be" Jul 29 15:04:24.136481 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.136449 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be"} err="failed to get container status \"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be\": rpc error: code = NotFound desc = could not find container \"689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be\": container with ID starting with 689a28362f078b98e1db0c12aa91da89a575825ebeafe016b88904e9fd2110be not found: ID does not exist" Jul 29 15:04:24.136481 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.136464 2562 scope.go:117] "RemoveContainer" containerID="0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf" Jul 29 15:04:24.136704 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:04:24.136689 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf\": container with ID starting with 0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf not found: ID does not exist" containerID="0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf" Jul 29 15:04:24.136749 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.136707 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf"} err="failed to get container status \"0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf\": rpc error: code = NotFound desc = could not find container \"0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf\": container with ID starting with 0293b9318fd7fd62c2b5c930329824f6b20de58e7d72e9a52e33f44c2daa6dbf not found: ID does not exist" Jul 29 15:04:24.156280 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:24.156504 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156493 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="config-reloader" Jul 29 15:04:24.156541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156505 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="config-reloader" Jul 29 15:04:24.156541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156519 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="alertmanager" Jul 29 15:04:24.156541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156525 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="alertmanager" Jul 29 15:04:24.156541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156534 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="prom-label-proxy" Jul 29 15:04:24.156541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156540 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="prom-label-proxy" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156547 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-web" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156552 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-web" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156561 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156567 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156573 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-metric" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156578 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-metric" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156584 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a371033d-64ba-4000-bdeb-bb029d84e481" containerName="console" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156589 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a371033d-64ba-4000-bdeb-bb029d84e481" containerName="console" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156595 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="init-config-reloader" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156601 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="init-config-reloader" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156637 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="alertmanager" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156644 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-web" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156650 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="prom-label-proxy" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156657 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="config-reloader" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156664 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a371033d-64ba-4000-bdeb-bb029d84e481" containerName="console" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156672 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy" Jul 29 15:04:24.156684 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.156681 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" containerName="kube-rbac-proxy-metric" Jul 29 15:04:24.196816 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.196786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:24.196970 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.196876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.208445 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 15:04:24.208577 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 15:04:24.208577 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208478 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 15:04:24.208667 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 15:04:24.208834 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208820 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 15:04:24.208884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vwn9v\"" Jul 29 15:04:24.208884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.208857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 15:04:24.209049 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.209037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 15:04:24.211117 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 15:04:24.211575 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-web-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211653 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211653 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211736 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-config-volume\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211736 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-tls-assets\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-config-out\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211994 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211994 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.211994 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.211961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clsrb\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-kube-api-access-clsrb\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.235803 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.235776 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 15:04:24.310662 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.310585 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a31d96-faa5-4a6e-b4be-4c36b372b320" path="/var/lib/kubelet/pods/27a31d96-faa5-4a6e-b4be-4c36b372b320/volumes" Jul 29 15:04:24.313008 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.312988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313067 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313067 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clsrb\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-kube-api-access-clsrb\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313067 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-web-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313209 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313267 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313315 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-config-volume\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313367 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313367 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-tls-assets\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-config-out\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313649 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.313857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.313833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.314184 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.314137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.314842 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.314815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/044a81d4-c272-4c41-8474-ca337689f402-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316406 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316406 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-config-volume\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/044a81d4-c272-4c41-8474-ca337689f402-config-out\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316624 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316601 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316779 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316758 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-web-config\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.316823 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.316766 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.317083 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.317066 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-tls-assets\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.317379 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.317359 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.318368 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.318346 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/044a81d4-c272-4c41-8474-ca337689f402-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.323277 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.323261 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clsrb\" (UniqueName: \"kubernetes.io/projected/044a81d4-c272-4c41-8474-ca337689f402-kube-api-access-clsrb\") pod \"alertmanager-main-0\" (UID: \"044a81d4-c272-4c41-8474-ca337689f402\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.506928 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.506893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 15:04:24.663942 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:24.663887 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 15:04:24.666032 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:04:24.666009 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044a81d4_c272_4c41_8474_ca337689f402.slice/crio-3eaf32478109194212ec6a3f6dfdb8375ee8b77c7a63acb7175fd1b096f3105f WatchSource:0}: Error finding container 3eaf32478109194212ec6a3f6dfdb8375ee8b77c7a63acb7175fd1b096f3105f: Status 404 returned error can't find the container with id 3eaf32478109194212ec6a3f6dfdb8375ee8b77c7a63acb7175fd1b096f3105f Jul 29 15:04:25.089748 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:25.089715 2562 generic.go:356] "Generic (PLEG): container finished" podID="044a81d4-c272-4c41-8474-ca337689f402" containerID="399c95e355cfc06a9d002e5ab1a2999c108db126f16a8b76298e49adf8ae774f" exitCode=0 Jul 29 15:04:25.090219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:25.089779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerDied","Data":"399c95e355cfc06a9d002e5ab1a2999c108db126f16a8b76298e49adf8ae774f"} Jul 29 15:04:25.090219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:25.089834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"3eaf32478109194212ec6a3f6dfdb8375ee8b77c7a63acb7175fd1b096f3105f"} Jul 29 15:04:26.096313 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"b16da610c4767b4753ef762ec3d9ea884cd3c0e2892dbf1fb6e7d72b4ca7ca99"} Jul 29 15:04:26.096689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"93a40cdc39654db1cd0a1ac035fa426e680943e5e595ef447b96dae597887638"} Jul 29 15:04:26.096689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"29aa08c3e6e1ac6572b32bf63c34ccfab6b9a8315b3ab8d98721822e75a8a01c"} Jul 29 15:04:26.096689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"25c490a3b97a5fc32405cd6e121c11b46e5e1b30ef3cc549e3df286cb908f756"} Jul 29 15:04:26.096689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"ef0c760582c57a5c7e5729ab40a54f7e54d2cd0218f387870e4d96dbaafabe23"} Jul 29 15:04:26.096689 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.096457 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"044a81d4-c272-4c41-8474-ca337689f402","Type":"ContainerStarted","Data":"53ca479d6f63ff24f5754b5adb7f0c5e62f4a8b85ff2a288f80359f6702fac6d"} Jul 29 15:04:26.139615 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.139562 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.125595961 podStartE2EDuration="2.139544793s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.948832ms" isStatefulPod=false podCreationTimestamp="2026-07-29 15:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:04:26.138633585 +0000 UTC m=+162.345396329" watchObservedRunningTime="2026-07-29 15:04:26.139544793 +0000 UTC m=+162.346307523" Jul 29 15:04:26.812880 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.812848 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc"] Jul 29 15:04:26.815343 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.815312 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.818093 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818075 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 15:04:26.818382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 15:04:26.818430 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818367 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 15:04:26.818473 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 15:04:26.818708 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 15:04:26.818784 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.818768 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9lkzz\"" Jul 29 15:04:26.828720 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.828696 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 15:04:26.833074 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-serving-certs-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pr4p\" (UniqueName: \"kubernetes.io/projected/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-kube-api-access-7pr4p\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833177 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833284 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833284 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833349 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-metrics-client-ca\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.833349 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.833332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-federate-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.838756 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.838734 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc"] Jul 29 15:04:26.933704 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-metrics-client-ca\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-federate-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-serving-certs-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pr4p\" (UniqueName: \"kubernetes.io/projected/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-kube-api-access-7pr4p\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.933889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.933872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.934700 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.934671 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-metrics-client-ca\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.934924 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.934894 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.935216 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.935189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-serving-certs-ca-bundle\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.936547 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.936524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.936716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.936693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-federate-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.936786 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.936702 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-telemeter-client-tls\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.936786 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.936764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-secret-telemeter-client\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:26.944561 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:26.944538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pr4p\" (UniqueName: \"kubernetes.io/projected/ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a-kube-api-access-7pr4p\") pod \"telemeter-client-5f7f779cd7-bs4wc\" (UID: \"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a\") " pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:27.126036 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:27.125965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" Jul 29 15:04:27.259475 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:27.259436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc"] Jul 29 15:04:27.262210 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:04:27.262174 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad65f13c_6ca5_4ea6_8d38_40f82d03ac6a.slice/crio-e4e6d4fa9bd6f7e55cc7c743719895fd81bb5e2275f6e033612097e85bac3512 WatchSource:0}: Error finding container e4e6d4fa9bd6f7e55cc7c743719895fd81bb5e2275f6e033612097e85bac3512: Status 404 returned error can't find the container with id e4e6d4fa9bd6f7e55cc7c743719895fd81bb5e2275f6e033612097e85bac3512 Jul 29 15:04:28.107074 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:28.107032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" event={"ID":"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a","Type":"ContainerStarted","Data":"e4e6d4fa9bd6f7e55cc7c743719895fd81bb5e2275f6e033612097e85bac3512"} Jul 29 15:04:29.112972 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:29.112942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" event={"ID":"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a","Type":"ContainerStarted","Data":"c54a7a9c7a9d90935ebdd13d08d251e08327f679c3282ff5a35918b003da34ae"} Jul 29 15:04:30.118502 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.118468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" event={"ID":"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a","Type":"ContainerStarted","Data":"106d6de66e999cb624723888232e5f8e4359185147b1f6fb8f69a993494bb9d3"} Jul 29 15:04:30.118884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.118522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" event={"ID":"ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a","Type":"ContainerStarted","Data":"dad2b0cc7dde9a48dc4ba50335be4c03d5a9c0e0bd2dfb058fb2f5ac42b3a966"} Jul 29 15:04:30.143846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.143788 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f7f779cd7-bs4wc" podStartSLOduration=2.39759681 podStartE2EDuration="4.143772536s" totalImagesPullingTime="1.746175726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:04:30.141389322 +0000 UTC m=+166.348152052" watchObservedRunningTime="2026-07-29 15:04:30.143772536 +0000 UTC m=+166.350535266" Jul 29 15:04:30.964000 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.963954 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:04:30.966375 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.966351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:30.979342 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:30.979304 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:04:31.024096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.024059 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:31.068198 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068362 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068362 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068362 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznhz\" (UniqueName: \"kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068362 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.068543 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.068433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.116502 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.116471 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:31.168775 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.168775 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznhz\" (UniqueName: \"kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.168978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169590 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.169560 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.169933 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.169862 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.170014 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.169965 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.170292 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.170273 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.171425 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.171397 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.171550 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.171531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.177637 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.177616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznhz\" (UniqueName: \"kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz\") pod \"console-56ffcf4868-tdx4q\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.274860 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.274835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:31.402425 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:31.402384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:04:31.406012 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:04:31.405980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53ce3dc_bd11_414e_83b0_5f777abe6caa.slice/crio-126887d1c88112f1262490ad72178bebebdccd5b0101855b51d5ef0932a8f68b WatchSource:0}: Error finding container 126887d1c88112f1262490ad72178bebebdccd5b0101855b51d5ef0932a8f68b: Status 404 returned error can't find the container with id 126887d1c88112f1262490ad72178bebebdccd5b0101855b51d5ef0932a8f68b Jul 29 15:04:32.127989 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:32.127956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ffcf4868-tdx4q" event={"ID":"a53ce3dc-bd11-414e-83b0-5f777abe6caa","Type":"ContainerStarted","Data":"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b"} Jul 29 15:04:32.128241 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:32.128003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ffcf4868-tdx4q" event={"ID":"a53ce3dc-bd11-414e-83b0-5f777abe6caa","Type":"ContainerStarted","Data":"126887d1c88112f1262490ad72178bebebdccd5b0101855b51d5ef0932a8f68b"} Jul 29 15:04:32.160297 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:32.160246 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56ffcf4868-tdx4q" podStartSLOduration=2.160228621 podStartE2EDuration="2.160228621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:04:32.159239449 +0000 UTC m=+168.366002207" watchObservedRunningTime="2026-07-29 15:04:32.160228621 +0000 UTC m=+168.366991350" Jul 29 15:04:41.275509 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:41.275412 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:41.275895 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:41.275524 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:41.280210 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:41.280190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:42.170974 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:42.170946 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:04:42.226525 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:42.226492 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:04:42.375408 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:42.375375 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:42.479541 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:42.479511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:04:42.581792 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:04:42.581757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:07.248757 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.248713 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c9bbd8b65-xbn9n" podUID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" containerName="console" containerID="cri-o://c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636" gracePeriod=15 Jul 29 15:05:07.504051 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.503982 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:05:07.686468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686429 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686470 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686506 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686581 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686614 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686716 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686646 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnm2p\" (UniqueName: \"kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p\") pod \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\" (UID: \"b34c7e22-f8a5-4d24-b360-9d6731a496cf\") " Jul 29 15:05:07.686980 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686948 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:05:07.686980 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.686962 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:05:07.687118 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.687096 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:05:07.687246 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.687215 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config" (OuterVolumeSpecName: "console-config") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:05:07.689037 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.689005 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:05:07.689137 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.689041 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:05:07.689137 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.689047 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p" (OuterVolumeSpecName: "kube-api-access-mnm2p") pod "b34c7e22-f8a5-4d24-b360-9d6731a496cf" (UID: "b34c7e22-f8a5-4d24-b360-9d6731a496cf"). InnerVolumeSpecName "kube-api-access-mnm2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787574 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787610 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787625 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnm2p\" (UniqueName: \"kubernetes.io/projected/b34c7e22-f8a5-4d24-b360-9d6731a496cf-kube-api-access-mnm2p\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787637 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-service-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787649 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-oauth-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787660 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34c7e22-f8a5-4d24-b360-9d6731a496cf-trusted-ca-bundle\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:07.787672 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:07.787672 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34c7e22-f8a5-4d24-b360-9d6731a496cf-console-oauth-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:05:08.268674 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.268638 2562 generic.go:356] "Generic (PLEG): container finished" podID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" containerID="c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636" exitCode=0 Jul 29 15:05:08.269071 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.268685 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9bbd8b65-xbn9n" Jul 29 15:05:08.269071 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.268722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9bbd8b65-xbn9n" event={"ID":"b34c7e22-f8a5-4d24-b360-9d6731a496cf","Type":"ContainerDied","Data":"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636"} Jul 29 15:05:08.269071 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.268805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9bbd8b65-xbn9n" event={"ID":"b34c7e22-f8a5-4d24-b360-9d6731a496cf","Type":"ContainerDied","Data":"f8387e7e6e162a0d32a5604813161bf66855677ac1a23677d5f8c9fdb93b4d80"} Jul 29 15:05:08.269071 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.268835 2562 scope.go:117] "RemoveContainer" containerID="c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636" Jul 29 15:05:08.277589 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.277568 2562 scope.go:117] "RemoveContainer" containerID="c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636" Jul 29 15:05:08.277864 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:05:08.277844 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636\": container with ID starting with c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636 not found: ID does not exist" containerID="c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636" Jul 29 15:05:08.277914 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.277874 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636"} err="failed to get container status \"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636\": rpc error: code = NotFound desc = could not find container \"c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636\": container with ID starting with c49b7ae19ae40c31c8bbd4aa02cffaa1400f261ecb319566b893272de3fa2636 not found: ID does not exist" Jul 29 15:05:08.289668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.289642 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:05:08.293572 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.293550 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9bbd8b65-xbn9n"] Jul 29 15:05:08.309544 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:08.309519 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" path="/var/lib/kubelet/pods/b34c7e22-f8a5-4d24-b360-9d6731a496cf/volumes" Jul 29 15:05:36.883046 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:36.883011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:36.951516 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:36.951487 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:42.945848 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:42.945815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:43.005575 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:43.005542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:48.869666 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:48.869598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:48.929094 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:48.929067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:50.171071 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.171035 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:05:50.171468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.171351 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" containerName="console" Jul 29 15:05:50.171468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.171361 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" containerName="console" Jul 29 15:05:50.171468 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.171403 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34c7e22-f8a5-4d24-b360-9d6731a496cf" containerName="console" Jul 29 15:05:50.173633 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.173614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.185380 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.185359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:05:50.232521 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232647 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6gl\" (UniqueName: \"kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.232809 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.232799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.233253 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.233234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:50.295352 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.295318 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:50.333467 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6gl\" (UniqueName: \"kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.333877 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.333797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.334166 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.334121 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.334316 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.334283 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.334446 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.334430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.334492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.334440 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.336631 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.336604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.336631 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.336607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.341874 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.341847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6gl\" (UniqueName: \"kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl\") pod \"console-699cdddc46-bm5lk\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.371286 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.371263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:50.432518 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.432441 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:50.483240 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.483206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:05:50.616483 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.616449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:05:50.619518 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:05:50.619492 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40183474_d19c_4066_b99d_e1c9e69d92cc.slice/crio-b8e3e2d3d20c532e4fd7226a3b7553e2a87e663dc0a80990276908dde91303f3 WatchSource:0}: Error finding container b8e3e2d3d20c532e4fd7226a3b7553e2a87e663dc0a80990276908dde91303f3: Status 404 returned error can't find the container with id b8e3e2d3d20c532e4fd7226a3b7553e2a87e663dc0a80990276908dde91303f3 Jul 29 15:05:50.971947 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:50.971915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:51.072842 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:51.072810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:51.429029 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:51.428948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699cdddc46-bm5lk" event={"ID":"40183474-d19c-4066-b99d-e1c9e69d92cc","Type":"ContainerStarted","Data":"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31"} Jul 29 15:05:51.429029 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:51.428997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699cdddc46-bm5lk" event={"ID":"40183474-d19c-4066-b99d-e1c9e69d92cc","Type":"ContainerStarted","Data":"b8e3e2d3d20c532e4fd7226a3b7553e2a87e663dc0a80990276908dde91303f3"} Jul 29 15:05:51.447470 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:51.447421 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-699cdddc46-bm5lk" podStartSLOduration=1.447402472 podStartE2EDuration="1.447402472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:05:51.446914511 +0000 UTC m=+247.653677241" watchObservedRunningTime="2026-07-29 15:05:51.447402472 +0000 UTC m=+247.654165202" Jul 29 15:05:58.410438 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:58.410400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:58.507159 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:58.507113 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:05:59.290046 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:05:59.290009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:06:00.483822 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:00.483790 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:06:00.484219 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:00.483846 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:06:00.488592 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:00.488569 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:06:01.468370 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:01.468340 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:06:01.538779 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:01.538750 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:06:01.656239 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:01.656209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:06:01.759996 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:01.759897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:06:01.844138 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:01.844104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:06:26.558477 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.558419 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56ffcf4868-tdx4q" podUID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" containerName="console" containerID="cri-o://f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b" gracePeriod=15 Jul 29 15:06:26.810114 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.810048 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:06:26.856074 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856040 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856256 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856099 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856256 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856134 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rznhz\" (UniqueName: \"kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856256 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856202 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856361 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856338 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856411 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856399 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856467 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856434 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca\") pod \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\" (UID: \"a53ce3dc-bd11-414e-83b0-5f777abe6caa\") " Jul 29 15:06:26.856560 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856538 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config" (OuterVolumeSpecName: "console-config") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:06:26.856732 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856707 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.856846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856745 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:06:26.856917 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.856850 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca" (OuterVolumeSpecName: "service-ca") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:06:26.857112 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.857091 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:06:26.858550 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.858520 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz" (OuterVolumeSpecName: "kube-api-access-rznhz") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "kube-api-access-rznhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:06:26.858669 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.858561 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:06:26.858669 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.858594 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a53ce3dc-bd11-414e-83b0-5f777abe6caa" (UID: "a53ce3dc-bd11-414e-83b0-5f777abe6caa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:06:26.957661 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957613 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-trusted-ca-bundle\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.957661 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957653 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.957661 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957664 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-oauth-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.957661 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957673 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53ce3dc-bd11-414e-83b0-5f777abe6caa-service-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.957661 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957681 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53ce3dc-bd11-414e-83b0-5f777abe6caa-console-oauth-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:26.957951 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:26.957689 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rznhz\" (UniqueName: \"kubernetes.io/projected/a53ce3dc-bd11-414e-83b0-5f777abe6caa-kube-api-access-rznhz\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:06:27.567774 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.567735 2562 generic.go:356] "Generic (PLEG): container finished" podID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" containerID="f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b" exitCode=0 Jul 29 15:06:27.568223 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.567805 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56ffcf4868-tdx4q" Jul 29 15:06:27.568223 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.567807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ffcf4868-tdx4q" event={"ID":"a53ce3dc-bd11-414e-83b0-5f777abe6caa","Type":"ContainerDied","Data":"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b"} Jul 29 15:06:27.568223 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.567941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56ffcf4868-tdx4q" event={"ID":"a53ce3dc-bd11-414e-83b0-5f777abe6caa","Type":"ContainerDied","Data":"126887d1c88112f1262490ad72178bebebdccd5b0101855b51d5ef0932a8f68b"} Jul 29 15:06:27.568223 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.567961 2562 scope.go:117] "RemoveContainer" containerID="f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b" Jul 29 15:06:27.576576 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.576556 2562 scope.go:117] "RemoveContainer" containerID="f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b" Jul 29 15:06:27.576854 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:06:27.576835 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b\": container with ID starting with f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b not found: ID does not exist" containerID="f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b" Jul 29 15:06:27.576914 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.576866 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b"} err="failed to get container status \"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b\": rpc error: code = NotFound desc = could not find container \"f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b\": container with ID starting with f8af341294b1b7b73846a9b8f746e846fbd2de29df734ba1a32da1db9c84a58b not found: ID does not exist" Jul 29 15:06:27.590942 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.590916 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:06:27.595062 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:27.595040 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56ffcf4868-tdx4q"] Jul 29 15:06:28.309220 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:28.309188 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" path="/var/lib/kubelet/pods/a53ce3dc-bd11-414e-83b0-5f777abe6caa/volumes" Jul 29 15:06:44.122629 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:06:44.122600 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 15:07:13.551464 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:13.551428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:40.127560 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:40.127483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:40.187330 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:40.187296 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:40.810361 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:40.810325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:40.911165 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:40.911098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:41.718495 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.718464 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj"] Jul 29 15:07:41.718855 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.718746 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" containerName="console" Jul 29 15:07:41.718855 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.718756 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" containerName="console" Jul 29 15:07:41.718855 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.718812 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53ce3dc-bd11-414e-83b0-5f777abe6caa" containerName="console" Jul 29 15:07:41.721628 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.721612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.724162 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.724124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 15:07:41.724295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.724162 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lv56w\"" Jul 29 15:07:41.724295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.724209 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 15:07:41.730837 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.730814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj"] Jul 29 15:07:41.876082 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.876048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.876276 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.876177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.876276 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.876212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7j9d\" (UniqueName: \"kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.977481 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.977406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.977481 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.977449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7j9d\" (UniqueName: \"kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.977632 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.977487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.977828 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.977809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.977872 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.977827 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:41.986918 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:41.986898 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7j9d\" (UniqueName: \"kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:42.031603 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:42.031575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:07:42.164832 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:42.164797 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj"] Jul 29 15:07:42.167750 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:07:42.167727 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8367fd6_df8c_4c32_b221_91263c7b4c76.slice/crio-840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf WatchSource:0}: Error finding container 840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf: Status 404 returned error can't find the container with id 840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf Jul 29 15:07:42.169794 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:42.169779 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:07:42.843753 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:42.843710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerStarted","Data":"840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf"} Jul 29 15:07:43.949174 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:43.949128 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:44.023079 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:44.023042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:07:48.869574 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:48.869536 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerID="2ca417372937446781ddfb1057d51c503a104b749985fddc0629771f1f2c698e" exitCode=0 Jul 29 15:07:48.869988 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:48.869620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerDied","Data":"2ca417372937446781ddfb1057d51c503a104b749985fddc0629771f1f2c698e"} Jul 29 15:07:50.880544 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:50.880514 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerStarted","Data":"e699ede9065da0c4d843c562a384ef49c646e981f1d4b30927f2855c400c294c"} Jul 29 15:07:51.885608 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:51.885577 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerID="e699ede9065da0c4d843c562a384ef49c646e981f1d4b30927f2855c400c294c" exitCode=0 Jul 29 15:07:51.886082 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:51.885639 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerDied","Data":"e699ede9065da0c4d843c562a384ef49c646e981f1d4b30927f2855c400c294c"} Jul 29 15:07:57.913488 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:57.913440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerStarted","Data":"8d3d22f15b61309d08e51614c40895be47c8c9d277ea8930926938536c6d31a9"} Jul 29 15:07:57.931614 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:57.931568 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" podStartSLOduration=3.301809946 podStartE2EDuration="16.931553758s" totalImagesPullingTime="13.629743812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:07:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:07:57.930634614 +0000 UTC m=+374.137397363" watchObservedRunningTime="2026-07-29 15:07:57.931553758 +0000 UTC m=+374.138316488" Jul 29 15:07:58.919295 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:58.919255 2562 generic.go:356] "Generic (PLEG): container finished" podID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerID="8d3d22f15b61309d08e51614c40895be47c8c9d277ea8930926938536c6d31a9" exitCode=0 Jul 29 15:07:58.919803 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:07:58.919306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerDied","Data":"8d3d22f15b61309d08e51614c40895be47c8c9d277ea8930926938536c6d31a9"} Jul 29 15:08:00.047516 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.047484 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:08:00.135425 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.135389 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle\") pod \"a8367fd6-df8c-4c32-b221-91263c7b4c76\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " Jul 29 15:08:00.135612 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.135459 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7j9d\" (UniqueName: \"kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d\") pod \"a8367fd6-df8c-4c32-b221-91263c7b4c76\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " Jul 29 15:08:00.135612 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.135514 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util\") pod \"a8367fd6-df8c-4c32-b221-91263c7b4c76\" (UID: \"a8367fd6-df8c-4c32-b221-91263c7b4c76\") " Jul 29 15:08:00.136101 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.136071 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle" (OuterVolumeSpecName: "bundle") pod "a8367fd6-df8c-4c32-b221-91263c7b4c76" (UID: "a8367fd6-df8c-4c32-b221-91263c7b4c76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:08:00.137705 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.137678 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d" (OuterVolumeSpecName: "kube-api-access-b7j9d") pod "a8367fd6-df8c-4c32-b221-91263c7b4c76" (UID: "a8367fd6-df8c-4c32-b221-91263c7b4c76"). InnerVolumeSpecName "kube-api-access-b7j9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:08:00.140548 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.140505 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util" (OuterVolumeSpecName: "util") pod "a8367fd6-df8c-4c32-b221-91263c7b4c76" (UID: "a8367fd6-df8c-4c32-b221-91263c7b4c76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 15:08:00.236620 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.236578 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-util\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:08:00.236620 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.236615 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8367fd6-df8c-4c32-b221-91263c7b4c76-bundle\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:08:00.236799 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.236629 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7j9d\" (UniqueName: \"kubernetes.io/projected/a8367fd6-df8c-4c32-b221-91263c7b4c76-kube-api-access-b7j9d\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:08:00.929832 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.929801 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" Jul 29 15:08:00.929832 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.929810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5rlgdj" event={"ID":"a8367fd6-df8c-4c32-b221-91263c7b4c76","Type":"ContainerDied","Data":"840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf"} Jul 29 15:08:00.930063 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:00.929850 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="840225e8ade5bfbf47ae9e45ab2ff7635faf1f3607bac2f33378e4a62d924cdf" Jul 29 15:08:03.511653 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:03.511617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:03.623061 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:03.623020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:05.450437 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450398 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b"] Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450680 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="pull" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450691 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="pull" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450712 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="extract" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450718 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="extract" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450725 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="util" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450730 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="util" Jul 29 15:08:05.450889 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.450774 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8367fd6-df8c-4c32-b221-91263c7b4c76" containerName="extract" Jul 29 15:08:05.464714 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.464690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.469694 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.469671 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 15:08:05.470483 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.470461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 15:08:05.470606 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.470494 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 15:08:05.473350 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.473314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-dkwnh\"" Jul 29 15:08:05.506505 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.506475 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b"] Jul 29 15:08:05.582668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.582620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mqs\" (UniqueName: \"kubernetes.io/projected/5c052cf5-c6b2-47d0-a920-26a219e135a0-kube-api-access-59mqs\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.582857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.582689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/5c052cf5-c6b2-47d0-a920-26a219e135a0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.683552 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.683517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mqs\" (UniqueName: \"kubernetes.io/projected/5c052cf5-c6b2-47d0-a920-26a219e135a0-kube-api-access-59mqs\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.683690 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.683562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/5c052cf5-c6b2-47d0-a920-26a219e135a0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.686024 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.686002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/5c052cf5-c6b2-47d0-a920-26a219e135a0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.707244 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.707187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mqs\" (UniqueName: \"kubernetes.io/projected/5c052cf5-c6b2-47d0-a920-26a219e135a0-kube-api-access-59mqs\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b\" (UID: \"5c052cf5-c6b2-47d0-a920-26a219e135a0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.774185 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.774129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:05.939512 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.939481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b"] Jul 29 15:08:05.942969 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:08:05.942945 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c052cf5_c6b2_47d0_a920_26a219e135a0.slice/crio-4682a5ad2daaea7e5f23edad89d356a7309b299256d0d89aa61b3341bd5a39a2 WatchSource:0}: Error finding container 4682a5ad2daaea7e5f23edad89d356a7309b299256d0d89aa61b3341bd5a39a2: Status 404 returned error can't find the container with id 4682a5ad2daaea7e5f23edad89d356a7309b299256d0d89aa61b3341bd5a39a2 Jul 29 15:08:05.949452 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:05.949429 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" event={"ID":"5c052cf5-c6b2-47d0-a920-26a219e135a0","Type":"ContainerStarted","Data":"4682a5ad2daaea7e5f23edad89d356a7309b299256d0d89aa61b3341bd5a39a2"} Jul 29 15:08:09.969161 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:09.969111 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:09.969592 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:09.969493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" event={"ID":"5c052cf5-c6b2-47d0-a920-26a219e135a0","Type":"ContainerStarted","Data":"a19fb68a2f64ef6ed509eef5b180667bc8f9c64e330a31c95cb8ca5f4811d8fb"} Jul 29 15:08:09.969656 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:09.969642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:09.992734 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:09.992679 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" podStartSLOduration=1.623113888 podStartE2EDuration="4.992648549s" totalImagesPullingTime="3.369534661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:08:09.991791682 +0000 UTC m=+386.198554412" watchObservedRunningTime="2026-07-29 15:08:09.992648549 +0000 UTC m=+386.199411273" Jul 29 15:08:10.321810 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.321727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:10.323992 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.323965 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-dnsjx"] Jul 29 15:08:10.338846 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.338811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.341796 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.341774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 15:08:10.341796 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.341787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 15:08:10.342812 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.342786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-s2pth\"" Jul 29 15:08:10.363176 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.363124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-dnsjx"] Jul 29 15:08:10.427749 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.427712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-cabundle0\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.427930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.427779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7brcz\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-kube-api-access-7brcz\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.427930 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.427816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.528311 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.528265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.528363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-cabundle0\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.528412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7brcz\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-kube-api-access-7brcz\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.528428 2562 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.528455 2562 secret.go:281] references non-existent secret key: ca.crt Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.528466 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 15:08:10.528500 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.528482 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-dnsjx: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 15:08:10.528744 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.528550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates podName:4bc1b8d0-251a-4e9e-9336-a6aaf5d19616 nodeName:}" failed. No retries permitted until 2026-07-29 15:08:11.028529958 +0000 UTC m=+387.235292666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates") pod "keda-operator-77f648d694-dnsjx" (UID: "4bc1b8d0-251a-4e9e-9336-a6aaf5d19616") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 15:08:10.529020 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.529002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-cabundle0\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.539830 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.539806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7brcz\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-kube-api-access-7brcz\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:10.543945 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.543924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:10.568531 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.568502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr"] Jul 29 15:08:10.585104 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.585033 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr"] Jul 29 15:08:10.585251 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.585128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.587671 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.587650 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 15:08:10.629387 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.629339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.629387 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.629404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/eaf40ea4-204f-465f-9f72-207e7eac1985-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.629644 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.629450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t84\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-kube-api-access-m9t84\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.649814 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.649775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:10.730111 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.730061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.730111 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.730117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/eaf40ea4-204f-465f-9f72-207e7eac1985-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.730383 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.730135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t84\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-kube-api-access-m9t84\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.730383 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.730260 2562 secret.go:281] references non-existent secret key: tls.crt Jul 29 15:08:10.730383 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.730281 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 15:08:10.730383 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.730301 2562 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 29 15:08:10.730383 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.730320 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 29 15:08:10.730614 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:10.730391 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates podName:eaf40ea4-204f-465f-9f72-207e7eac1985 nodeName:}" failed. No retries permitted until 2026-07-29 15:08:11.230369444 +0000 UTC m=+387.437132166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates") pod "keda-metrics-apiserver-55557df8c-t5xpr" (UID: "eaf40ea4-204f-465f-9f72-207e7eac1985") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 29 15:08:10.730614 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.730535 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/eaf40ea4-204f-465f-9f72-207e7eac1985-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.750429 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.750404 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t84\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-kube-api-access-m9t84\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:10.871997 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:10.871916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.033212 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.033174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:11.035914 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.035878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4bc1b8d0-251a-4e9e-9336-a6aaf5d19616-certificates\") pod \"keda-operator-77f648d694-dnsjx\" (UID: \"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616\") " pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:11.105835 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.105800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.110002 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.109978 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-t58tt"] Jul 29 15:08:11.112350 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.112336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.114839 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.114823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 29 15:08:11.128116 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.128064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-t58tt"] Jul 29 15:08:11.196488 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.196452 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.235240 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.235202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ncnf\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-kube-api-access-9ncnf\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.235382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.235251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:11.235382 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.235271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.237822 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.237801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/eaf40ea4-204f-465f-9f72-207e7eac1985-certificates\") pod \"keda-metrics-apiserver-55557df8c-t5xpr\" (UID: \"eaf40ea4-204f-465f-9f72-207e7eac1985\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:11.249109 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.249071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:11.335782 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.335743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ncnf\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-kube-api-access-9ncnf\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.335919 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.335801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.336029 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:11.336014 2562 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 29 15:08:11.336090 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:11.336041 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-t58tt: secret "keda-admission-webhooks-certs" not found Jul 29 15:08:11.336162 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:08:11.336105 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates podName:dffbecaf-3662-486f-8cd0-b2c08da1df30 nodeName:}" failed. No retries permitted until 2026-07-29 15:08:11.836083227 +0000 UTC m=+388.042845938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates") pod "keda-admission-56f9798bb4-t58tt" (UID: "dffbecaf-3662-486f-8cd0-b2c08da1df30") : secret "keda-admission-webhooks-certs" not found Jul 29 15:08:11.357410 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.357374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ncnf\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-kube-api-access-9ncnf\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.386069 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.386047 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-dnsjx"] Jul 29 15:08:11.388351 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:08:11.388325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc1b8d0_251a_4e9e_9336_a6aaf5d19616.slice/crio-994c5d3a610d2b254c1532983fd8772e20c91ec5a760143b902359ffcac7916b WatchSource:0}: Error finding container 994c5d3a610d2b254c1532983fd8772e20c91ec5a760143b902359ffcac7916b: Status 404 returned error can't find the container with id 994c5d3a610d2b254c1532983fd8772e20c91ec5a760143b902359ffcac7916b Jul 29 15:08:11.496121 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.496084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:11.516474 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.516449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.634622 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.634596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr"] Jul 29 15:08:11.636196 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:08:11.636113 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf40ea4_204f_465f_9f72_207e7eac1985.slice/crio-df9d4b303a6b599990a69cc1761fcdfb63abcc160016ad995363bc02197c399d WatchSource:0}: Error finding container df9d4b303a6b599990a69cc1761fcdfb63abcc160016ad995363bc02197c399d: Status 404 returned error can't find the container with id df9d4b303a6b599990a69cc1761fcdfb63abcc160016ad995363bc02197c399d Jul 29 15:08:11.639624 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.639601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.840805 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.840762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.843384 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.843363 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dffbecaf-3662-486f-8cd0-b2c08da1df30-certificates\") pod \"keda-admission-56f9798bb4-t58tt\" (UID: \"dffbecaf-3662-486f-8cd0-b2c08da1df30\") " pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:11.903719 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.903626 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:11.979577 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.979541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-dnsjx" event={"ID":"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616","Type":"ContainerStarted","Data":"994c5d3a610d2b254c1532983fd8772e20c91ec5a760143b902359ffcac7916b"} Jul 29 15:08:11.980713 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:11.980686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" event={"ID":"eaf40ea4-204f-465f-9f72-207e7eac1985","Type":"ContainerStarted","Data":"df9d4b303a6b599990a69cc1761fcdfb63abcc160016ad995363bc02197c399d"} Jul 29 15:08:12.022191 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:12.022136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:12.087448 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:12.087419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:08:12.177798 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:12.177649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-t58tt"] Jul 29 15:08:12.180250 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:08:12.180223 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffbecaf_3662_486f_8cd0_b2c08da1df30.slice/crio-67078be14d82f19a1b2f2a194ea8a48a650cfccadd34a8d82ace0975c33c41b4 WatchSource:0}: Error finding container 67078be14d82f19a1b2f2a194ea8a48a650cfccadd34a8d82ace0975c33c41b4: Status 404 returned error can't find the container with id 67078be14d82f19a1b2f2a194ea8a48a650cfccadd34a8d82ace0975c33c41b4 Jul 29 15:08:12.988027 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:12.987983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" event={"ID":"dffbecaf-3662-486f-8cd0-b2c08da1df30","Type":"ContainerStarted","Data":"67078be14d82f19a1b2f2a194ea8a48a650cfccadd34a8d82ace0975c33c41b4"} Jul 29 15:08:16.004163 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.004113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-dnsjx" event={"ID":"4bc1b8d0-251a-4e9e-9336-a6aaf5d19616","Type":"ContainerStarted","Data":"98c1c5cbd5f7c1de3bb369282a4ea7844a2fe5d6fc8b17dc0f31157cf3ebc0d8"} Jul 29 15:08:16.004587 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.004307 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:16.005764 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.005736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" event={"ID":"dffbecaf-3662-486f-8cd0-b2c08da1df30","Type":"ContainerStarted","Data":"47c681e53aea43cf3aa8d3bd628d0f234cc2a26f21810682588c894bf2b537e1"} Jul 29 15:08:16.005927 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.005822 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:08:16.007291 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.007270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" event={"ID":"eaf40ea4-204f-465f-9f72-207e7eac1985","Type":"ContainerStarted","Data":"bf1b20dc22a8f37a8fe4560c45559d39730c88b83446d66d42cd6a12d6c28804"} Jul 29 15:08:16.007380 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.007327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:16.034395 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.034349 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-dnsjx" podStartSLOduration=1.6372354919999998 podStartE2EDuration="6.034335329s" totalImagesPullingTime="4.397099837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:08:16.033612499 +0000 UTC m=+392.240375250" watchObservedRunningTime="2026-07-29 15:08:16.034335329 +0000 UTC m=+392.241098059" Jul 29 15:08:16.065881 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.065819 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" podStartSLOduration=1.916270535 podStartE2EDuration="6.065797946s" totalImagesPullingTime="4.149527411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:08:16.064841791 +0000 UTC m=+392.271604522" watchObservedRunningTime="2026-07-29 15:08:16.065797946 +0000 UTC m=+392.272560677" Jul 29 15:08:16.106826 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:16.106378 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" podStartSLOduration=1.5132549910000002 podStartE2EDuration="5.106356382s" totalImagesPullingTime="3.593101391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:08:16.106242121 +0000 UTC m=+392.313004855" watchObservedRunningTime="2026-07-29 15:08:16.106356382 +0000 UTC m=+392.313119114" Jul 29 15:08:27.016387 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:27.016354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-t5xpr" Jul 29 15:08:30.976563 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:30.976533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-d7t2b" Jul 29 15:08:37.014281 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:37.014251 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-dnsjx" Jul 29 15:08:37.014752 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:08:37.014337 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-t58tt" Jul 29 15:09:29.644561 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.644528 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:29.714879 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.714846 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-844cf74686-td5qq"] Jul 29 15:09:29.717161 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.717122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:29.719380 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.719357 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 29 15:09:29.719492 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.719408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-qbxxt\"" Jul 29 15:09:29.720313 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.720300 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 15:09:29.720380 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.720303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 15:09:29.729744 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.729721 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-844cf74686-td5qq"] Jul 29 15:09:29.752279 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.752256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:29.756275 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.756254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-8hbkx"] Jul 29 15:09:29.758696 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.758672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:29.760954 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.760935 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 29 15:09:29.761061 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.760988 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-gfj5c\"" Jul 29 15:09:29.768977 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.768958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-8hbkx"] Jul 29 15:09:29.807884 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.807848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:29.808008 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.807887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6j8\" (UniqueName: \"kubernetes.io/projected/414ae87d-7ec1-41a8-a74f-19be5a347401-kube-api-access-rg6j8\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:29.842854 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.842813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:29.909020 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.908942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmqwj\" (UniqueName: \"kubernetes.io/projected/5092017b-8a83-48d6-8ee8-47c3a011c14e-kube-api-access-xmqwj\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:29.909020 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.908982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:29.909020 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.909003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6j8\" (UniqueName: \"kubernetes.io/projected/414ae87d-7ec1-41a8-a74f-19be5a347401-kube-api-access-rg6j8\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:29.909290 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:09:29.909090 2562 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 29 15:09:29.909290 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.909117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5092017b-8a83-48d6-8ee8-47c3a011c14e-data\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:29.909290 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:09:29.909166 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert podName:414ae87d-7ec1-41a8-a74f-19be5a347401 nodeName:}" failed. No retries permitted until 2026-07-29 15:09:30.40912785 +0000 UTC m=+466.615890558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert") pod "kserve-controller-manager-844cf74686-td5qq" (UID: "414ae87d-7ec1-41a8-a74f-19be5a347401") : secret "kserve-webhook-server-cert" not found Jul 29 15:09:29.917904 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:29.917884 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6j8\" (UniqueName: \"kubernetes.io/projected/414ae87d-7ec1-41a8-a74f-19be5a347401-kube-api-access-rg6j8\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:30.010227 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.010194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmqwj\" (UniqueName: \"kubernetes.io/projected/5092017b-8a83-48d6-8ee8-47c3a011c14e-kube-api-access-xmqwj\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:30.010405 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.010243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5092017b-8a83-48d6-8ee8-47c3a011c14e-data\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:30.010628 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.010607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5092017b-8a83-48d6-8ee8-47c3a011c14e-data\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:30.019233 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.019207 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmqwj\" (UniqueName: \"kubernetes.io/projected/5092017b-8a83-48d6-8ee8-47c3a011c14e-kube-api-access-xmqwj\") pod \"seaweedfs-64568bcd49-8hbkx\" (UID: \"5092017b-8a83-48d6-8ee8-47c3a011c14e\") " pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:30.030500 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.030478 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:30.067303 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.067280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:30.193677 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.193655 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-8hbkx"] Jul 29 15:09:30.196314 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:09:30.196285 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5092017b_8a83_48d6_8ee8_47c3a011c14e.slice/crio-4001068f758ccdaf05a9a54ac58eb2fac3d705de6c04bd7a6e3eb4e551688b02 WatchSource:0}: Error finding container 4001068f758ccdaf05a9a54ac58eb2fac3d705de6c04bd7a6e3eb4e551688b02: Status 404 returned error can't find the container with id 4001068f758ccdaf05a9a54ac58eb2fac3d705de6c04bd7a6e3eb4e551688b02 Jul 29 15:09:30.233675 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.233648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:30.324773 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.324742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-8hbkx" event={"ID":"5092017b-8a83-48d6-8ee8-47c3a011c14e","Type":"ContainerStarted","Data":"4001068f758ccdaf05a9a54ac58eb2fac3d705de6c04bd7a6e3eb4e551688b02"} Jul 29 15:09:30.330642 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.330613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:30.413538 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.413497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:30.416003 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.415981 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/414ae87d-7ec1-41a8-a74f-19be5a347401-cert\") pod \"kserve-controller-manager-844cf74686-td5qq\" (UID: \"414ae87d-7ec1-41a8-a74f-19be5a347401\") " pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:30.430659 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.430632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:30.627333 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.627286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:30.786022 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:30.785998 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-844cf74686-td5qq"] Jul 29 15:09:30.788260 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:09:30.788232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414ae87d_7ec1_41a8_a74f_19be5a347401.slice/crio-7bc46d37e96421afa0d5a88a35ce58f29275983e417d08a092f4a3cde91ae730 WatchSource:0}: Error finding container 7bc46d37e96421afa0d5a88a35ce58f29275983e417d08a092f4a3cde91ae730: Status 404 returned error can't find the container with id 7bc46d37e96421afa0d5a88a35ce58f29275983e417d08a092f4a3cde91ae730 Jul 29 15:09:31.332740 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:31.332688 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-844cf74686-td5qq" event={"ID":"414ae87d-7ec1-41a8-a74f-19be5a347401","Type":"ContainerStarted","Data":"7bc46d37e96421afa0d5a88a35ce58f29275983e417d08a092f4a3cde91ae730"} Jul 29 15:09:34.350526 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:34.350483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-8hbkx" event={"ID":"5092017b-8a83-48d6-8ee8-47c3a011c14e","Type":"ContainerStarted","Data":"81498064fd6a5107f519a24ffed4398a19d7c2545c740ef03aa76f72e5beb91c"} Jul 29 15:09:34.350956 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:34.350622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:34.368114 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:34.368060 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-8hbkx" podStartSLOduration=2.009872697 podStartE2EDuration="5.368043017s" totalImagesPullingTime="3.35817032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:34.367061892 +0000 UTC m=+470.573824641" watchObservedRunningTime="2026-07-29 15:09:34.368043017 +0000 UTC m=+470.574805748" Jul 29 15:09:36.359750 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:36.359715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-844cf74686-td5qq" event={"ID":"414ae87d-7ec1-41a8-a74f-19be5a347401","Type":"ContainerStarted","Data":"796b1c86ad4740c23f954618eb51fdee66c8e4c1e0db0c1a0b0a00cfda167bab"} Jul 29 15:09:36.360135 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:36.359789 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:09:36.375613 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:36.375569 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-844cf74686-td5qq" podStartSLOduration=2.834390239 podStartE2EDuration="7.375554172s" totalImagesPullingTime="4.541163933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:36.373976397 +0000 UTC m=+472.580739127" watchObservedRunningTime="2026-07-29 15:09:36.375554172 +0000 UTC m=+472.582316903" Jul 29 15:09:40.356858 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:40.356826 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-8hbkx" Jul 29 15:09:45.321602 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.321565 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d866c4c94-tl47n"] Jul 29 15:09:45.324422 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.324405 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.330823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.330877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nts\" (UniqueName: \"kubernetes.io/projected/693d4e53-1e36-45f7-b94e-a7fae71879c3-kube-api-access-x7nts\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.330957 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-oauth-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.330984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-trusted-ca-bundle\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.331007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-oauth-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331096 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.331095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.331383 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.331170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-service-ca\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.340841 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.338316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d866c4c94-tl47n"] Jul 29 15:09:45.388042 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.388011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:45.431898 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.431864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.431904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-service-ca\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.431928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.431948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nts\" (UniqueName: \"kubernetes.io/projected/693d4e53-1e36-45f7-b94e-a7fae71879c3-kube-api-access-x7nts\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-oauth-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-trusted-ca-bundle\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432087 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-oauth-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432820 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432985 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432914 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-oauth-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.432985 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-service-ca\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.433110 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.432986 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/693d4e53-1e36-45f7-b94e-a7fae71879c3-trusted-ca-bundle\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.434566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.434542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-oauth-config\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.434681 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.434661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/693d4e53-1e36-45f7-b94e-a7fae71879c3-console-serving-cert\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.442641 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.442624 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nts\" (UniqueName: \"kubernetes.io/projected/693d4e53-1e36-45f7-b94e-a7fae71879c3-kube-api-access-x7nts\") pod \"console-7d866c4c94-tl47n\" (UID: \"693d4e53-1e36-45f7-b94e-a7fae71879c3\") " pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.465066 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.465038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:45.633847 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.633758 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:45.773254 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:45.773226 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d866c4c94-tl47n"] Jul 29 15:09:45.775095 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:09:45.775044 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693d4e53_1e36_45f7_b94e_a7fae71879c3.slice/crio-44fee4c24f0870866a427668b45d74453db8047f2b97f78ac70500b629d67523 WatchSource:0}: Error finding container 44fee4c24f0870866a427668b45d74453db8047f2b97f78ac70500b629d67523: Status 404 returned error can't find the container with id 44fee4c24f0870866a427668b45d74453db8047f2b97f78ac70500b629d67523 Jul 29 15:09:46.401958 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:46.401922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d866c4c94-tl47n" event={"ID":"693d4e53-1e36-45f7-b94e-a7fae71879c3","Type":"ContainerStarted","Data":"b5f42d6c7d5f6b28b0529d832a9867bcba217be9276e5ff2e25a81214f3134dc"} Jul 29 15:09:46.402349 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:46.401980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d866c4c94-tl47n" event={"ID":"693d4e53-1e36-45f7-b94e-a7fae71879c3","Type":"ContainerStarted","Data":"44fee4c24f0870866a427668b45d74453db8047f2b97f78ac70500b629d67523"} Jul 29 15:09:46.419429 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:46.419382 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d866c4c94-tl47n" podStartSLOduration=1.419366486 podStartE2EDuration="1.419366486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:09:46.417708399 +0000 UTC m=+482.624471128" watchObservedRunningTime="2026-07-29 15:09:46.419366486 +0000 UTC m=+482.626129216" Jul 29 15:09:55.634491 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:55.634444 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:55.635118 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:55.634532 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:55.639379 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:55.639352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:56.450662 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:56.450633 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d866c4c94-tl47n" Jul 29 15:09:56.500237 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:56.500199 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:09:56.630026 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:56.629987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:56.730091 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:56.730054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:09:56.831347 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:09:56.831314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:10:07.369805 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:07.369776 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-844cf74686-td5qq" Jul 29 15:10:21.520407 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.520347 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-699cdddc46-bm5lk" podUID="40183474-d19c-4066-b99d-e1c9e69d92cc" containerName="console" containerID="cri-o://95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31" gracePeriod=15 Jul 29 15:10:21.772086 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.772025 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:10:21.847727 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847692 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.847900 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847734 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.847900 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847768 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.847995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847891 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.847995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847953 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.847995 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.847986 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg6gl\" (UniqueName: \"kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.848129 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848019 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config\") pod \"40183474-d19c-4066-b99d-e1c9e69d92cc\" (UID: \"40183474-d19c-4066-b99d-e1c9e69d92cc\") " Jul 29 15:10:21.848227 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848187 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:21.848301 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848282 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-trusted-ca-bundle\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.848301 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848286 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:21.848482 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848397 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config" (OuterVolumeSpecName: "console-config") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:21.848482 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.848432 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 15:10:21.850076 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.850050 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:10:21.850203 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.850170 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl" (OuterVolumeSpecName: "kube-api-access-fg6gl") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "kube-api-access-fg6gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 15:10:21.850740 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.850725 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "40183474-d19c-4066-b99d-e1c9e69d92cc" (UID: "40183474-d19c-4066-b99d-e1c9e69d92cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 15:10:21.948909 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948869 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.948909 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948901 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-service-ca\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.948909 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948911 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-console-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.948909 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948919 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg6gl\" (UniqueName: \"kubernetes.io/projected/40183474-d19c-4066-b99d-e1c9e69d92cc-kube-api-access-fg6gl\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.949213 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948928 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40183474-d19c-4066-b99d-e1c9e69d92cc-console-oauth-config\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:21.949213 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:21.948937 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40183474-d19c-4066-b99d-e1c9e69d92cc-oauth-serving-cert\") on node \"ip-10-0-130-151.ec2.internal\" DevicePath \"\"" Jul 29 15:10:22.557922 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.557883 2562 generic.go:356] "Generic (PLEG): container finished" podID="40183474-d19c-4066-b99d-e1c9e69d92cc" containerID="95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31" exitCode=0 Jul 29 15:10:22.558357 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.557934 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699cdddc46-bm5lk" Jul 29 15:10:22.558357 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.557963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699cdddc46-bm5lk" event={"ID":"40183474-d19c-4066-b99d-e1c9e69d92cc","Type":"ContainerDied","Data":"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31"} Jul 29 15:10:22.558357 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.558015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699cdddc46-bm5lk" event={"ID":"40183474-d19c-4066-b99d-e1c9e69d92cc","Type":"ContainerDied","Data":"b8e3e2d3d20c532e4fd7226a3b7553e2a87e663dc0a80990276908dde91303f3"} Jul 29 15:10:22.558357 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.558036 2562 scope.go:117] "RemoveContainer" containerID="95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31" Jul 29 15:10:22.566475 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.566458 2562 scope.go:117] "RemoveContainer" containerID="95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31" Jul 29 15:10:22.566826 ip-10-0-130-151 kubenswrapper[2562]: E0729 15:10:22.566776 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31\": container with ID starting with 95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31 not found: ID does not exist" containerID="95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31" Jul 29 15:10:22.566826 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.566803 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31"} err="failed to get container status \"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31\": rpc error: code = NotFound desc = could not find container \"95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31\": container with ID starting with 95cd2b7a1e585971306f80e71f7fead399e63924b36a5b869ebc7aa86e207c31 not found: ID does not exist" Jul 29 15:10:22.581839 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.581805 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:10:22.601444 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:22.601410 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-699cdddc46-bm5lk"] Jul 29 15:10:24.309890 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:10:24.309858 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40183474-d19c-4066-b99d-e1c9e69d92cc" path="/var/lib/kubelet/pods/40183474-d19c-4066-b99d-e1c9e69d92cc/volumes" Jul 29 15:11:57.442729 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:11:57.442699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:19.295493 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:12:19.295447 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:47.698188 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:12:47.698126 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:48.969969 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:12:48.969929 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:12:49.031374 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:12:49.031342 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:18.376171 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:13:18.376121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:18.444305 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:13:18.444271 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:13:41.329934 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:13:41.329848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:08.643287 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:14:08.643253 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:14:18.992761 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:14:18.992717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:18:37.866984 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:18:37.866944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:39.847221 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:19:39.847121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:19:39.908903 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:19:39.908869 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.305263 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.305230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.424793 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.424760 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7g5l2/must-gather-mws8b"] Jul 29 15:20:00.425136 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.425121 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40183474-d19c-4066-b99d-e1c9e69d92cc" containerName="console" Jul 29 15:20:00.425209 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.425155 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="40183474-d19c-4066-b99d-e1c9e69d92cc" containerName="console" Jul 29 15:20:00.425245 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.425217 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="40183474-d19c-4066-b99d-e1c9e69d92cc" containerName="console" Jul 29 15:20:00.428185 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.428169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.430668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.430639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7g5l2\"/\"openshift-service-ca.crt\"" Jul 29 15:20:00.430668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.430668 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7g5l2\"/\"default-dockercfg-xxrpk\"" Jul 29 15:20:00.430885 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.430667 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7g5l2\"/\"kube-root-ca.crt\"" Jul 29 15:20:00.441828 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.441805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/must-gather-mws8b"] Jul 29 15:20:00.444676 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.444647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.533225 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.533186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrmx\" (UniqueName: \"kubernetes.io/projected/28223760-ec31-4f9f-9c92-65844e08f8d0-kube-api-access-7lrmx\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.533412 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.533273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28223760-ec31-4f9f-9c92-65844e08f8d0-must-gather-output\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.545190 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.545160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:00.634518 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.634442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrmx\" (UniqueName: \"kubernetes.io/projected/28223760-ec31-4f9f-9c92-65844e08f8d0-kube-api-access-7lrmx\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.634518 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.634494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28223760-ec31-4f9f-9c92-65844e08f8d0-must-gather-output\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.634791 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.634776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/28223760-ec31-4f9f-9c92-65844e08f8d0-must-gather-output\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.643095 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.643065 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrmx\" (UniqueName: \"kubernetes.io/projected/28223760-ec31-4f9f-9c92-65844e08f8d0-kube-api-access-7lrmx\") pod \"must-gather-mws8b\" (UID: \"28223760-ec31-4f9f-9c92-65844e08f8d0\") " pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.748085 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.748051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/must-gather-mws8b" Jul 29 15:20:00.885668 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.885644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/must-gather-mws8b"] Jul 29 15:20:00.888443 ip-10-0-130-151 kubenswrapper[2562]: W0729 15:20:00.888420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28223760_ec31_4f9f_9c92_65844e08f8d0.slice/crio-6fa74701b9401984e72b5e0d377f045477a77659d6d8b54bcd7da2079ea93acc WatchSource:0}: Error finding container 6fa74701b9401984e72b5e0d377f045477a77659d6d8b54bcd7da2079ea93acc: Status 404 returned error can't find the container with id 6fa74701b9401984e72b5e0d377f045477a77659d6d8b54bcd7da2079ea93acc Jul 29 15:20:00.890651 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:00.890633 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 15:20:01.067776 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:01.067736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/must-gather-mws8b" event={"ID":"28223760-ec31-4f9f-9c92-65844e08f8d0","Type":"ContainerStarted","Data":"6fa74701b9401984e72b5e0d377f045477a77659d6d8b54bcd7da2079ea93acc"} Jul 29 15:20:03.078988 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:03.078939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/must-gather-mws8b" event={"ID":"28223760-ec31-4f9f-9c92-65844e08f8d0","Type":"ContainerStarted","Data":"65f6ece88c6f943512533086bdf7bf4ad5146aeb3a345b4c7e366cf82bc289d5"} Jul 29 15:20:03.079494 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:03.078994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/must-gather-mws8b" event={"ID":"28223760-ec31-4f9f-9c92-65844e08f8d0","Type":"ContainerStarted","Data":"32cd7ebc70f5c15adadf1c68b36e8d7122377a8bb7fdf77814b704a846e9bd8c"} Jul 29 15:20:03.100629 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:03.100573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7g5l2/must-gather-mws8b" podStartSLOduration=1.532446544 podStartE2EDuration="3.100555153s" totalImagesPullingTime="1.568108609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 15:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:20:03.099359661 +0000 UTC m=+1099.306122390" watchObservedRunningTime="2026-07-29 15:20:03.100555153 +0000 UTC m=+1099.307317882" Jul 29 15:20:03.950058 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:03.950016 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5bv4x_a4620880-af96-4b41-b6fc-2bf2e816aaa7/global-pull-secret-syncer/0.log" Jul 29 15:20:04.050561 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:04.050529 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" Jul 29 15:20:04.135331 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:04.135297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-151.ec2.internal_afe1a7c4734bb08de9989144eeaa56b2/haproxy/0.log" Jul 29 15:20:05.951604 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:05.951569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:06.052436 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:06.052401 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrrhj_893997c6-be51-4a60-9394-8d135ca6bbbb/konnectivity-agent/0.log" limit=1024 Jul 29 15:20:08.504758 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.504726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/alertmanager/0.log" Jul 29 15:20:08.532006 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.531975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/config-reloader/0.log" Jul 29 15:20:08.559595 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.559565 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/kube-rbac-proxy-web/0.log" Jul 29 15:20:08.601408 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.601378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/kube-rbac-proxy/0.log" Jul 29 15:20:08.651842 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.651806 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/kube-rbac-proxy-metric/0.log" Jul 29 15:20:08.700074 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.700045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/prom-label-proxy/0.log" Jul 29 15:20:08.727886 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.727851 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_044a81d4-c272-4c41-8474-ca337689f402/init-config-reloader/0.log" Jul 29 15:20:08.793437 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.793358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5xmv9_31be1938-0a63-4fa7-8df5-e8d03c23f512/kube-state-metrics/0.log" Jul 29 15:20:08.824807 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.824775 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5xmv9_31be1938-0a63-4fa7-8df5-e8d03c23f512/kube-rbac-proxy-main/0.log" Jul 29 15:20:08.851903 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.851873 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-5xmv9_31be1938-0a63-4fa7-8df5-e8d03c23f512/kube-rbac-proxy-self/0.log" Jul 29 15:20:08.890017 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.889992 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79c8cf7795-knmng_6cb90ba7-ae9a-4583-bde9-c454c2b2dbcd/metrics-server/0.log" Jul 29 15:20:08.922896 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:08.922867 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-skksd_224c5bcc-dd8c-4537-8f5d-cf40420e2ca8/monitoring-plugin/0.log" Jul 29 15:20:09.104081 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.103996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xn9s7_6760182f-5500-493d-9081-c9c1e7ca85f4/node-exporter/0.log" Jul 29 15:20:09.128926 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.128901 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xn9s7_6760182f-5500-493d-9081-c9c1e7ca85f4/kube-rbac-proxy/0.log" Jul 29 15:20:09.150306 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.150280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xn9s7_6760182f-5500-493d-9081-c9c1e7ca85f4/init-textfile/0.log" Jul 29 15:20:09.181391 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.181358 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-528nq_feb12150-8984-4f1c-a1f7-36cb8fa03281/kube-rbac-proxy-main/0.log" Jul 29 15:20:09.207396 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.207361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-528nq_feb12150-8984-4f1c-a1f7-36cb8fa03281/kube-rbac-proxy-self/0.log" Jul 29 15:20:09.230892 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.230858 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-528nq_feb12150-8984-4f1c-a1f7-36cb8fa03281/openshift-state-metrics/0.log" Jul 29 15:20:09.542333 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.542293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7f779cd7-bs4wc_ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a/telemeter-client/0.log" Jul 29 15:20:09.567451 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.567421 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7f779cd7-bs4wc_ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a/reload/0.log" Jul 29 15:20:09.596706 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:09.596671 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7f779cd7-bs4wc_ad65f13c-6ca5-4ea6-8d38-40f82d03ac6a/kube-rbac-proxy/0.log" Jul 29 15:20:11.759036 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:11.759008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d866c4c94-tl47n_693d4e53-1e36-45f7-b94e-a7fae71879c3/console/0.log" Jul 29 15:20:11.792473 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:11.792442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-vvkvx_17c5de61-6167-4f58-acbc-141eadaf22e2/download-server/0.log" Jul 29 15:20:13.306302 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.306262 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dpzgn_cf7247a8-e3d7-4262-95bd-61d624b0fd1d/dns/0.log" Jul 29 15:20:13.333432 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.333400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dpzgn_cf7247a8-e3d7-4262-95bd-61d624b0fd1d/kube-rbac-proxy/0.log" Jul 29 15:20:13.410602 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.410567 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr"] Jul 29 15:20:13.417644 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.417615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.437712 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.437680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr"] Jul 29 15:20:13.457443 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.457411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-podres\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.457638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.457459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-lib-modules\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.457638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.457480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-proc\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.457638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.457577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-sys\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.457638 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.457622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trklt\" (UniqueName: \"kubernetes.io/projected/3509c9c8-241b-4805-bb27-3ed194b850e8-kube-api-access-trklt\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.521870 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.521837 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfvf2_99aa0c42-14e4-4267-be04-9d7a4e2e0096/dns-node-resolver/0.log" Jul 29 15:20:13.558858 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-podres\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.558858 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-lib-modules\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.558858 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-proc\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-sys\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trklt\" (UniqueName: \"kubernetes.io/projected/3509c9c8-241b-4805-bb27-3ed194b850e8-kube-api-access-trklt\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-proc\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.559002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-lib-modules\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.559018 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-sys\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.559122 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.558977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3509c9c8-241b-4805-bb27-3ed194b850e8-podres\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.571539 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.571512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trklt\" (UniqueName: \"kubernetes.io/projected/3509c9c8-241b-4805-bb27-3ed194b850e8-kube-api-access-trklt\") pod \"perf-node-gather-daemonset-dzcvr\" (UID: \"3509c9c8-241b-4805-bb27-3ed194b850e8\") " pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.728719 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.728688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:13.895098 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:13.895063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr"] Jul 29 15:20:14.097105 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.097022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8687978b4d-82t4p_1e10c7bc-fb72-443d-9c0c-64c804e0696f/registry/0.log" Jul 29 15:20:14.142746 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.142703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" event={"ID":"3509c9c8-241b-4805-bb27-3ed194b850e8","Type":"ContainerStarted","Data":"311a55f89d3dbb359408509fd305ab25ca749285926678d810f7da8edd4cbfe1"} Jul 29 15:20:14.142913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.142768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" event={"ID":"3509c9c8-241b-4805-bb27-3ed194b850e8","Type":"ContainerStarted","Data":"8c83247b93575f39b3b5042f8f1b38c10c1bd126b39ec8a378cec5662cfcca98"} Jul 29 15:20:14.142913 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.142798 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:14.152397 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.152366 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n29qb_93c25b1d-01be-41b4-9981-bfbcfc4a15d9/node-ca/0.log" Jul 29 15:20:14.164876 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:14.164833 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" podStartSLOduration=1.1648176160000001 podStartE2EDuration="1.164817616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 15:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 15:20:14.162717386 +0000 UTC m=+1110.369480116" watchObservedRunningTime="2026-07-29 15:20:14.164817616 +0000 UTC m=+1110.371580378" Jul 29 15:20:15.330311 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:15.330271 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hq5k4_f7b3b145-39f4-48f2-93ec-cadd89885d1b/serve-healthcheck-canary/0.log" Jul 29 15:20:15.701857 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:15.701777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cctgz_e7a1f276-4ece-410d-8688-bbddd57bfad0/kube-rbac-proxy/0.log" Jul 29 15:20:15.731623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:15.731584 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cctgz_e7a1f276-4ece-410d-8688-bbddd57bfad0/exporter/0.log" Jul 29 15:20:15.758302 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:15.758273 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cctgz_e7a1f276-4ece-410d-8688-bbddd57bfad0/extractor/0.log" Jul 29 15:20:18.207872 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:18.207846 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-844cf74686-td5qq_414ae87d-7ec1-41a8-a74f-19be5a347401/manager/0.log" Jul 29 15:20:18.260986 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:18.260957 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-8hbkx_5092017b-8a83-48d6-8ee8-47c3a011c14e/seaweedfs/0.log" Jul 29 15:20:20.162081 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:20.162052 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7g5l2/perf-node-gather-daemonset-dzcvr" Jul 29 15:20:24.002028 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.001993 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/kube-multus-additional-cni-plugins/0.log" Jul 29 15:20:24.026319 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.026290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/egress-router-binary-copy/0.log" Jul 29 15:20:24.046604 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.046575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/cni-plugins/0.log" Jul 29 15:20:24.071522 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.071499 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/bond-cni-plugin/0.log" Jul 29 15:20:24.092357 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.092328 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/routeoverride-cni/0.log" Jul 29 15:20:24.113798 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.113770 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/whereabouts-cni-bincopy/0.log" Jul 29 15:20:24.134532 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.134505 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qp766_eefb86b4-c29f-4d91-bdf2-431cfe31a4bf/whereabouts-cni/0.log" Jul 29 15:20:24.164166 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.164058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c2jfn_09b7ba2b-9a63-49eb-bff8-5da0ce48528e/kube-multus/0.log" Jul 29 15:20:24.216614 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.216585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lhch_031d0230-5940-4209-8211-f60cb3c2986f/network-metrics-daemon/0.log" Jul 29 15:20:24.236923 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:24.236893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lhch_031d0230-5940-4209-8211-f60cb3c2986f/kube-rbac-proxy/0.log" Jul 29 15:20:25.278601 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.278571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/ovn-controller/0.log" Jul 29 15:20:25.294158 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.294113 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/ovn-acl-logging/0.log" Jul 29 15:20:25.317611 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.317560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/kube-rbac-proxy-node/0.log" Jul 29 15:20:25.337337 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.337313 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 15:20:25.359623 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.359600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/northd/0.log" Jul 29 15:20:25.382080 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.382055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/nbdb/0.log" Jul 29 15:20:25.405856 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.405827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/sbdb/0.log" Jul 29 15:20:25.466566 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:25.466538 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nt92p_84287bc9-df3c-49f9-94a8-87beff5dbf4a/ovnkube-controller/0.log" Jul 29 15:20:26.749629 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:26.749492 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-75jqd_cc886772-62b8-4927-a3a4-f0c18d79a370/network-check-target-container/0.log" Jul 29 15:20:27.727938 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:27.727907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fq6vl_4bb1c00e-bf26-4a47-b47d-ce69153e0ac3/iptables-alerter/0.log" Jul 29 15:20:28.411164 ip-10-0-130-151 kubenswrapper[2562]: I0729 15:20:28.411124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vn4s9_ab8cb8a0-48c2-4730-a94b-86be1b14025d/tuned/0.log"