Jul 31 14:46:13.384736 ip-10-0-130-97 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 31 14:46:13.384748 ip-10-0-130-97 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 31 14:46:13.384758 ip-10-0-130-97 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 31 14:46:13.385076 ip-10-0-130-97 systemd[1]: Failed to start Kubernetes Kubelet. Jul 31 14:46:23.092881 ip-10-0-130-97 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 31 14:46:23.092894 ip-10-0-130-97 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e110b7f7160942bd9591c7f9bc628f43 -- Jul 31 14:47:50.503039 ip-10-0-130-97 systemd[1]: Starting Kubernetes Kubelet... Jul 31 14:47:50.944953 ip-10-0-130-97 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:50.944953 ip-10-0-130-97 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 14:47:50.944953 ip-10-0-130-97 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:50.944953 ip-10-0-130-97 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 14:47:50.944953 ip-10-0-130-97 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:50.947849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.947742 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 14:47:50.952746 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952730 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.952746 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952745 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952749 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952754 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952757 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952760 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952763 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952766 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952780 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952784 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952787 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952800 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952804 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952806 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952809 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952812 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952814 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952817 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952819 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952822 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.952851 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952825 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952829 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952833 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952836 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952839 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952842 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952845 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952847 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952850 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952853 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952856 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952858 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952863 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952866 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952870 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952873 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952876 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952880 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952883 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.953312 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952886 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952888 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952891 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952894 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952897 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952900 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952902 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952905 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952907 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952910 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952919 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952922 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952925 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952927 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952930 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952934 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952936 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952939 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952942 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952944 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.953795 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952947 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952950 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952952 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952955 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952957 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952960 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952963 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952965 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952968 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952970 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952974 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952977 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952980 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952982 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952985 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952987 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952992 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952996 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.952999 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.954318 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953002 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953005 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953008 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953011 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953014 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953016 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953019 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953021 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953025 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953028 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953031 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953034 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953036 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953039 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953042 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953045 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953047 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953050 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953052 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953055 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.954769 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953057 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953801 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953809 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953812 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953816 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953820 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953823 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953826 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953829 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953832 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953835 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953839 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953841 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953844 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953847 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953850 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953853 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953855 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953858 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953861 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.955339 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953864 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953867 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953870 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953873 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953875 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953878 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953880 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953883 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953886 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953888 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953891 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953893 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953896 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953898 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953901 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953904 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953906 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953909 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953913 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.956141 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953917 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953921 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953924 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953927 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953930 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953933 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953936 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953938 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953941 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953943 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953946 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953948 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953951 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953955 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953957 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953960 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953963 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953966 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953968 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953972 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.956725 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953975 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953977 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953980 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953982 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953985 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953987 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953990 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953993 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953995 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.953998 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954001 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954003 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954006 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954009 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954013 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954016 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954019 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954022 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954025 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.957246 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954028 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954031 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954033 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954036 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954038 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954042 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954048 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954051 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954054 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954056 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954059 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954062 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954065 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954068 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954070 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954073 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954075 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954078 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954080 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.957717 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954083 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954085 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954088 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954477 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954482 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954485 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954488 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954492 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954495 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954497 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954500 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954502 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954505 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954508 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954510 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954513 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954516 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954518 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954521 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954524 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.958216 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954527 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954529 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954532 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954535 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954537 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954540 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954543 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954545 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954548 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954550 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954553 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954556 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954558 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954560 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954563 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954565 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954568 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954570 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954573 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954576 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.958729 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954578 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954581 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954583 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954586 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954588 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954591 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954593 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954595 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954598 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954600 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954606 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954609 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954612 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954614 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954617 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954619 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954622 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954625 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954627 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954630 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.959233 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954632 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954636 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954639 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954642 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954646 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954649 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954653 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954656 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954659 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954662 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954666 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954668 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954671 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954674 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954677 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954680 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954682 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954685 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954687 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.959825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954690 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954693 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954696 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954700 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954703 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954706 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954709 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954711 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954714 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954716 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954719 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954722 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954724 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954727 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954729 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954732 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954734 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954737 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954739 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954742 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.960367 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954744 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954748 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.954751 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954834 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954843 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954852 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954859 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954866 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954871 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954875 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954880 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954883 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954886 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954889 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954893 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954898 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954901 2564 flags.go:64] FLAG: --cgroup-root="" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954904 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954907 2564 flags.go:64] FLAG: --client-ca-file="" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954910 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954913 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954918 2564 flags.go:64] FLAG: --cluster-domain="" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954921 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 14:47:50.960889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954924 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954927 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954931 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954934 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954937 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954940 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954944 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954947 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954950 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.954953 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955018 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955029 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955036 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955041 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955046 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955051 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955068 2564 flags.go:64] FLAG: --enable-server="true" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955073 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955087 2564 flags.go:64] FLAG: --event-burst="100" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955092 2564 flags.go:64] FLAG: --event-qps="50" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955097 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955103 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955108 2564 flags.go:64] FLAG: --eviction-hard="" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955174 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 14:47:50.961486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955201 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955210 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955218 2564 flags.go:64] FLAG: --eviction-soft="" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955224 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955231 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955237 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955243 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955255 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955261 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955266 2564 flags.go:64] FLAG: --feature-gates="" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955274 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955280 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955285 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955291 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955297 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955303 2564 flags.go:64] FLAG: --help="false" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955313 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-97.ec2.internal" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955319 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955324 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955329 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955336 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955343 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955348 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 14:47:50.962067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955353 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955363 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955369 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955375 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955381 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955386 2564 flags.go:64] FLAG: --kube-reserved="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955391 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955396 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955401 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955409 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955419 2564 flags.go:64] FLAG: --lock-file="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955424 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955429 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955433 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955442 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955447 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955452 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955456 2564 flags.go:64] FLAG: --logging-format="text" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955461 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955472 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955477 2564 flags.go:64] FLAG: --manifest-url="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955481 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955489 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955494 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955501 2564 flags.go:64] FLAG: --max-pods="110" Jul 31 14:47:50.962682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955506 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955510 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955520 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955525 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955530 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955535 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955540 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955555 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955560 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955571 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955576 2564 flags.go:64] FLAG: --pod-cidr="" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955581 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955590 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955595 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955600 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955605 2564 flags.go:64] FLAG: --port="10250" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955613 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955624 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0206cc89a93744901" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955629 2564 flags.go:64] FLAG: --qos-reserved="" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955634 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955639 2564 flags.go:64] FLAG: --register-node="true" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955644 2564 flags.go:64] FLAG: --register-with-taints="" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955650 2564 flags.go:64] FLAG: --registry-burst="10" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955655 2564 flags.go:64] FLAG: --registry-qps="5" Jul 31 14:47:50.963311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955660 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955665 2564 flags.go:64] FLAG: --reserved-memory="" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955676 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955681 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955686 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955691 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955696 2564 flags.go:64] FLAG: --runonce="false" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955701 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955706 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955711 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955721 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955726 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955731 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955736 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955741 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955745 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955751 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955755 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955760 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955787 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955793 2564 flags.go:64] FLAG: --system-cgroups="" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955797 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955808 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955813 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955821 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 14:47:50.963912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955829 2564 flags.go:64] FLAG: --tls-min-version="" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955841 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955846 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955850 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955866 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955887 2564 flags.go:64] FLAG: --v="2" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955896 2564 flags.go:64] FLAG: --version="false" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955904 2564 flags.go:64] FLAG: --vmodule="" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955912 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.955919 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956281 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956288 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956291 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956294 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956297 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956300 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956303 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956307 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956310 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956312 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956315 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956318 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.964531 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956321 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956324 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956327 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956330 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956332 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956335 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956338 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956341 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956343 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956346 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956348 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956351 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956354 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956356 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956360 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956363 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956366 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956368 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956371 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.965227 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956374 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956376 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956379 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956382 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956384 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956387 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956390 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956393 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956395 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956398 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956400 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956403 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956406 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956408 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956411 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956414 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956416 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956419 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956421 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956424 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.965999 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956426 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956429 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956432 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956434 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956444 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956448 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956452 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956455 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956461 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956464 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956467 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956469 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956472 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956475 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956477 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956480 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956483 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956485 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956490 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956493 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.966590 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956496 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956499 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956502 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956504 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956507 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956509 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956513 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956517 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956520 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956523 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956526 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956529 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956531 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956535 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956539 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956542 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956545 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956548 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956551 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.967110 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956554 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956562 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956565 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956568 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956571 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956573 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956576 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956579 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.956582 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.956588 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.963922 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.963938 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.963957 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.963963 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964024 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.967581 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964030 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964033 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964036 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964039 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964042 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964045 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964047 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964050 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964053 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964055 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964058 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964061 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964063 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964066 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964068 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964071 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964074 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964076 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964079 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964082 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.968098 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964084 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964087 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964090 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964093 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964095 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964098 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964102 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964106 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964110 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964113 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964116 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964120 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964122 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964125 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964128 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964130 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964133 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964136 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964138 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964141 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.968587 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964144 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964147 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964149 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964152 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964154 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964157 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964161 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964165 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964168 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964171 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964174 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964177 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964180 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964182 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964185 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964188 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964190 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964193 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964196 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.969088 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964199 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964201 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964204 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964207 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964210 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964212 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964215 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964217 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964220 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964223 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964225 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964227 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964230 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964232 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964235 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964238 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964240 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964243 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964245 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.969588 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964248 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964250 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964254 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964258 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964260 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964263 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964266 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964268 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964271 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964273 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964276 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964278 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964281 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964284 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964286 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964289 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964292 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964294 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964297 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.970060 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964299 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.964304 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964425 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964429 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964431 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964434 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964437 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964448 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964451 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964455 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964458 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964461 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964463 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964466 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964468 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:50.970524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964471 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964473 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964476 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964478 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964482 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964484 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964487 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964489 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964492 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964494 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964497 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964499 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964502 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964505 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964508 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964510 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964513 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964516 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964518 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964521 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:50.970905 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964525 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964528 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964531 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964535 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964538 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964541 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964544 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964549 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964552 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964555 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964558 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964561 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964564 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964566 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964569 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964571 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964574 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964577 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964579 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:50.971381 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964582 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964584 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964587 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964589 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964592 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964595 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964598 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964600 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964602 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964605 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964608 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964610 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964613 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964615 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964618 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964620 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964623 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964626 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964628 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964631 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:50.971857 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964633 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964637 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964639 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964642 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964645 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964647 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964650 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964652 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964657 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964660 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964662 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964665 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964667 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964670 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964672 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964675 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964677 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964680 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964682 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:50.972368 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964685 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964688 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964690 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964692 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964695 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964697 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:50.964700 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.964705 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.964842 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.967406 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.969079 2564 server.go:1019] "Starting client certificate rotation" Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.969177 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.969999 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:50.972876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.972009 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:50.973436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.973419 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:50.981820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.981800 2564 log.go:25] "Validated CRI v1 runtime API" Jul 31 14:47:50.987489 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.987472 2564 log.go:25] "Validated CRI v1 image API" Jul 31 14:47:50.988407 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.988383 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 14:47:50.991103 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.991082 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81da7b49-f0d7-43d4-aaec-a1febe934059:/dev/nvme0n1p3 9c2d6adc-94df-4ed1-b925-4c7d4d1d80b9:/dev/nvme0n1p4] Jul 31 14:47:50.991178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.991105 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 14:47:50.999792 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.999617 2564 manager.go:216] Machine: {Timestamp:2026-07-31 14:47:50.998052703 +0000 UTC m=+0.369019526 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092759 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2795a9621c5cfddb7ebf5cdf197d2c SystemUUID:ec2795a9-621c-5cfd-db7e-bf5cdf197d2c BootID:e110b7f7-1609-42bd-9591-c7f9bc628f43 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:1b:bb:c0:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:1b:bb:c0:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:e6:00:74:34:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 14:47:50.999792 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.999761 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 14:47:50.999950 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:50.999878 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 14:47:51.001674 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.001657 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:47:51.003325 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.003297 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 14:47:51.003503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.003330 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 14:47:51.004230 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.004218 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 14:47:51.004271 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.004235 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 14:47:51.004271 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.004245 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:51.004271 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.004264 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:51.005538 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.005526 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 14:47:51.010739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.010727 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:51.010939 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.010928 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 14:47:51.010982 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.010965 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 31 14:47:51.010982 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.010977 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 14:47:51.011045 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.010995 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 14:47:51.011045 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.011007 2564 kubelet.go:398] "Adding apiserver pod source" Jul 31 14:47:51.011045 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.011018 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 14:47:51.011422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.011410 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:51.011483 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.011433 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:51.013821 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.013804 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 14:47:51.015670 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.015657 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 14:47:51.015712 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.015688 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 14:47:51.017154 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017141 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 14:47:51.017154 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017157 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017163 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017169 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017178 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017183 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017191 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017196 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017203 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017208 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017216 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017221 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017243 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 14:47:51.017264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.017248 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 14:47:51.020534 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.020516 2564 server.go:1268] "Started kubelet" Jul 31 14:47:51.020624 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.020596 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 14:47:51.020729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.020661 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 14:47:51.020806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.020756 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 14:47:51.021377 ip-10-0-130-97 systemd[1]: Started Kubernetes Kubelet. Jul 31 14:47:51.021622 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.021466 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 14:47:51.021622 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.021541 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 14:47:51.021622 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.021578 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 14:47:51.022403 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.022385 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 14:47:51.022912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.022899 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 31 14:47:51.026605 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.026587 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 14:47:51.028602 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.027504 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-97.ec2.internal.18c76738d257d659 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-97.ec2.internal,UID:ip-10-0-130-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-97.ec2.internal,},FirstTimestamp:2026-07-31 14:47:51.020492377 +0000 UTC m=+0.391459199,LastTimestamp:2026-07-31 14:47:51.020492377 +0000 UTC m=+0.391459199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-97.ec2.internal,}" Jul 31 14:47:51.029733 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.029716 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 14:47:51.029733 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.029727 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 14:47:51.029897 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.029807 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.030580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030529 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 14:47:51.030580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030561 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 14:47:51.030580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030573 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 14:47:51.030762 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030695 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 31 14:47:51.030762 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030707 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 31 14:47:51.030869 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030768 2564 factory.go:153] Registering CRI-O factory Jul 31 14:47:51.030869 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030811 2564 factory.go:223] Registration of the crio container factory successfully Jul 31 14:47:51.030953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030873 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 14:47:51.030953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030883 2564 factory.go:55] Registering systemd factory Jul 31 14:47:51.030953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030890 2564 factory.go:223] Registration of the systemd container factory successfully Jul 31 14:47:51.030953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030925 2564 factory.go:103] Registering Raw factory Jul 31 14:47:51.030953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.030938 2564 manager.go:1196] Started watching for new ooms in manager Jul 31 14:47:51.031877 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.031861 2564 manager.go:349] Starting recovery of all containers Jul 31 14:47:51.038042 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.038011 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 14:47:51.038123 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.038106 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 14:47:51.040878 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.040831 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 14:47:51.045222 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.045207 2564 manager.go:354] Recovery completed Jul 31 14:47:51.050912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.050896 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.052597 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.052581 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-896rm" Jul 31 14:47:51.053514 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.053498 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.053583 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.053528 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.053583 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.053539 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.054117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.054097 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 14:47:51.054117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.054114 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 14:47:51.054237 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.054131 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:51.054237 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.054114 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.055452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.055427 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.055530 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.055459 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.055530 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.055475 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.055593 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.055513 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-97.ec2.internal.18c76738d44fb576 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-97.ec2.internal,UID:ip-10-0-130-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-97.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-97.ec2.internal,},FirstTimestamp:2026-07-31 14:47:51.053514102 +0000 UTC m=+0.424480924,LastTimestamp:2026-07-31 14:47:51.053514102 +0000 UTC m=+0.424480924,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-97.ec2.internal,}" Jul 31 14:47:51.056323 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.056308 2564 policy_none.go:49] "None policy: Start" Jul 31 14:47:51.056394 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.056329 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 14:47:51.056394 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.056342 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 14:47:51.058413 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.058399 2564 policy_none.go:47] "Start" Jul 31 14:47:51.065165 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.065002 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-896rm" Jul 31 14:47:51.067748 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.067673 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-97.ec2.internal.18c76738d44ffe81 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-97.ec2.internal,UID:ip-10-0-130-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-97.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-97.ec2.internal,},FirstTimestamp:2026-07-31 14:47:51.053532801 +0000 UTC m=+0.424499622,LastTimestamp:2026-07-31 14:47:51.053532801 +0000 UTC m=+0.424499622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-97.ec2.internal,}" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.094480 2564 manager.go:337] "Starting Device Plugin manager" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.094507 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.094518 2564 server.go:87] "Starting device plugin registration server" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.094801 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.094814 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.094923 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.095042 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.095051 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.095559 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.095610 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.097461 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.097497 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.097517 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.097558 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 14:47:51.108153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.099482 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:51.195019 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.194909 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.195972 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.195949 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.196074 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.195985 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.196074 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.196006 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.196074 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.196032 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.198220 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.198183 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal"] Jul 31 14:47:51.198321 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.198252 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.199014 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.199000 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.199093 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.199025 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.199093 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.199034 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.201415 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.201403 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.201528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.201515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.201563 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.201543 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.202091 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.202177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202090 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.202177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202099 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.202177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202111 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.202177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202122 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.202177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.202112 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.204401 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.204386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.204462 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.204415 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:51.205037 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.205021 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:51.205109 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.205045 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:51.205109 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.205054 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:51.206480 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.206466 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.206555 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.206490 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-97.ec2.internal\": node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.227040 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.227014 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.228400 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.228382 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-97.ec2.internal\" not found" node="ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.232688 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.232665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e504157da6704e201008e686b90b4bd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-97.ec2.internal\" (UID: \"0e504157da6704e201008e686b90b4bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.232763 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.232693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.232763 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.232709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.232763 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.232713 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-97.ec2.internal\" not found" node="ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.328141 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.328107 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.333519 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.333615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e504157da6704e201008e686b90b4bd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-97.ec2.internal\" (UID: \"0e504157da6704e201008e686b90b4bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.333615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.333615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.333615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d090ab9441b0c1810580b6868e0caf4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal\" (UID: \"d090ab9441b0c1810580b6868e0caf4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.333615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.333604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e504157da6704e201008e686b90b4bd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-97.ec2.internal\" (UID: \"0e504157da6704e201008e686b90b4bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.428738 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.428694 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.529427 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.529348 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.532612 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.532592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.536832 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.536819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:51.630469 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.630435 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.730819 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.730791 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.831174 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.831106 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.877161 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.877141 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:51.915026 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.915005 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:51.931847 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:51.931827 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:51.968067 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.968046 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 14:47:51.968422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.968152 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:51.968422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.968178 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:51.968422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:51.968192 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:52.032203 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:52.032176 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:52.071581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.071549 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 14:42:50 +0000 UTC" deadline="2028-01-30 08:06:48.223267341 +0000 UTC" Jul 31 14:47:52.071581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.071577 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13145h18m56.151693221s" Jul 31 14:47:52.078703 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.078682 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:52.080221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.080202 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:52.080292 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.080238 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:52.080292 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.080252 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:52.133097 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:52.133038 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:52.189827 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:52.189797 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e504157da6704e201008e686b90b4bd.slice/crio-64eaed3daa5d8e7bb1971311dcfbe4d8b1335ba22c008c831f765bb8964e1559 WatchSource:0}: Error finding container 64eaed3daa5d8e7bb1971311dcfbe4d8b1335ba22c008c831f765bb8964e1559: Status 404 returned error can't find the container with id 64eaed3daa5d8e7bb1971311dcfbe4d8b1335ba22c008c831f765bb8964e1559 Jul 31 14:47:52.190297 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:52.190282 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd090ab9441b0c1810580b6868e0caf4c.slice/crio-456788a1a9a69b618015f238c80d0775faf9d8a182a0366c1a237b3cb64a720b WatchSource:0}: Error finding container 456788a1a9a69b618015f238c80d0775faf9d8a182a0366c1a237b3cb64a720b: Status 404 returned error can't find the container with id 456788a1a9a69b618015f238c80d0775faf9d8a182a0366c1a237b3cb64a720b Jul 31 14:47:52.193869 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.193856 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:47:52.233682 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:52.233646 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:52.334001 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:52.333977 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-97.ec2.internal\" not found" Jul 31 14:47:52.391159 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.391094 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:52.431007 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.430970 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" Jul 31 14:47:52.440663 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.440643 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:47:52.441650 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.441636 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" Jul 31 14:47:52.457707 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:52.457687 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:47:53.011943 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.011909 2564 apiserver.go:52] "Watching apiserver" Jul 31 14:47:53.017747 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.017716 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 14:47:53.018266 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.018243 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2pb6w","kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k","openshift-cluster-node-tuning-operator/tuned-b494h","openshift-image-registry/node-ca-v8j88","openshift-multus/multus-additional-cni-plugins-47hhq","openshift-multus/multus-bkt4s","openshift-dns/node-resolver-vxq87","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal","openshift-multus/network-metrics-daemon-zt6tc","openshift-network-diagnostics/network-check-target-kgnw9","openshift-network-operator/iptables-alerter-jj9lw","openshift-ovn-kubernetes/ovnkube-node-wp76d","kube-system/global-pull-secret-syncer-cs8rz"] Jul 31 14:47:53.020892 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.020874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.022759 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.022738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.024472 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.024454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.024682 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.024665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9hzt8\"" Jul 31 14:47:53.024856 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.024843 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 14:47:53.025031 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.025014 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 14:47:53.025193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.025179 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.025815 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.025629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.026619 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.026601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.026798 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.026908 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.027148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.027291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wv8q6\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.027443 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.027586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.027871 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.028076 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rr9h5\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.028081 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.028233 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.028570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.028236 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.029095 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.029039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.033186 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.033168 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.033420 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.033404 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pkb8m\"" Jul 31 14:47:53.033624 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.033610 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.035126 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.034789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.035126 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.034872 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:47:53.035425 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.035114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.035881 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.035860 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 14:47:53.037751 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.037260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.040628 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.040819 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.040833 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.040958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041025 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.041421 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041225 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ctwcr\"" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-netns\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-dbus\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-k8s-cni-cncf-io\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-kubelet\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-binary-copy\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-systemd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-conf\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-tuned\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a079510b-d28d-4970-b93c-3460728b05d4-serviceca\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-node-log\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.041729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzxk\" (UniqueName: \"kubernetes.io/projected/d12c80ac-a1e7-47e0-ac70-147bbe409805-kube-api-access-ffzxk\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-sys\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-log-socket\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-modprobe-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-var-lib-kubelet\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-bin\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-kubernetes\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.041981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-kubelet-config\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042024 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s4qdc\"" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-cnibin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxvw\" (UniqueName: \"kubernetes.io/projected/a6814e71-b973-443f-b87b-975f85d20e3c-kube-api-access-mmxvw\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8k9\" (UniqueName: \"kubernetes.io/projected/f6fd891a-dc19-4cfa-99fd-9785861e0865-kube-api-access-9j8k9\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.043197 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-systemd-units\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-system-cni-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zdk\" (UniqueName: \"kubernetes.io/projected/f865f6e2-2201-457e-b4f9-2978235da0b7-kube-api-access-87zdk\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-konnectivity-ca\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-os-release\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-socket-dir-parent\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-var-lib-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-cnibin\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-script-lib\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-kubelet\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-system-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-multus\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-multus-daemon-config\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxtb8\" (UniqueName: \"kubernetes.io/projected/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kube-api-access-dxtb8\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-slash\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovn-node-metrics-cert\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.043636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-host\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysconfig\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a079510b-d28d-4970-b93c-3460728b05d4-host\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgr9\" (UniqueName: \"kubernetes.io/projected/a079510b-d28d-4970-b93c-3460728b05d4-kube-api-access-qvgr9\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-device-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-os-release\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-etc-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-env-overrides\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-run\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-lib-modules\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-tmp\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-agent-certs\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-netd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-cni-binary-copy\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-netns\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-multus-certs\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-etc-kubernetes\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-ovn\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-config\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-systemd\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.042987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-bin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.043008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-hostroot\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.043029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-conf-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.043050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.043073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.043097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.044981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.044906 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 14:47:53.045514 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.045101 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 14:47:53.045514 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.045249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.045837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wfkfx\"" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.046052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.046201 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.046863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.046905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lvzsk\"" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.046929 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.048341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:53.048655 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.048423 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:47:53.050957 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.050510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.052031 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.051898 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:47:53.052374 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.052357 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:47:53.052661 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.052643 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 14:47:53.052884 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.052868 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 14:47:53.053090 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.053060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7fcf7\"" Jul 31 14:47:53.073094 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.073078 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mfsd6" Jul 31 14:47:53.080148 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.080129 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mfsd6" Jul 31 14:47:53.104089 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.104043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" event={"ID":"d090ab9441b0c1810580b6868e0caf4c","Type":"ContainerStarted","Data":"456788a1a9a69b618015f238c80d0775faf9d8a182a0366c1a237b3cb64a720b"} Jul 31 14:47:53.104837 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.104815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" event={"ID":"0e504157da6704e201008e686b90b4bd","Type":"ContainerStarted","Data":"64eaed3daa5d8e7bb1971311dcfbe4d8b1335ba22c008c831f765bb8964e1559"} Jul 31 14:47:53.131430 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.131395 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 14:47:53.143599 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-kubelet\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.143750 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-system-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.143750 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-multus\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.143750 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-multus-daemon-config\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.143750 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxtb8\" (UniqueName: \"kubernetes.io/projected/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kube-api-access-dxtb8\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-host-slash\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-slash\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovn-node-metrics-cert\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-host\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.143948 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysconfig\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.143954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a079510b-d28d-4970-b93c-3460728b05d4-host\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgr9\" (UniqueName: \"kubernetes.io/projected/a079510b-d28d-4970-b93c-3460728b05d4-kube-api-access-qvgr9\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-device-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-os-release\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-etc-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-env-overrides\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-run\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-lib-modules\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-tmp\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-agent-certs\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-netd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-cni-binary-copy\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-netns\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-multus-certs\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-etc-kubernetes\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-ovn\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-config\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-systemd\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-bin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.144842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144794 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-etc-kubernetes\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-bin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-system-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144928 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-ovn\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.144982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-multus-certs\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.145192 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-etc-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.145431 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-cni-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145701 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-host\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145758 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysconfig\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-hostroot\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-conf-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145892 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72whl\" (UniqueName: \"kubernetes.io/projected/50eefe5b-80d0-4590-be39-a7f07ed822d8-kube-api-access-72whl\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-iptables-alerter-script\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-netns\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.145994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-dbus\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-k8s-cni-cncf-io\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-cni-binary-copy\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-kubelet\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50eefe5b-80d0-4590-be39-a7f07ed822d8-hosts-file\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-binary-copy\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.146125 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-hostroot\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146147 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-kubelet\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-dbus\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-slash\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146181 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146188 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-netns\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-systemd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146222 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-k8s-cni-cncf-io\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-run\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-systemd\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-conf-dir\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146348 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-device-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146378 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-kubelet\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-os-release\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-run-netns\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-registration-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146573 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.147028 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-env-overrides\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-conf\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-binary-copy\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-netd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-tuned\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-run-systemd\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a079510b-d28d-4970-b93c-3460728b05d4-serviceca\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-node-log\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzxk\" (UniqueName: \"kubernetes.io/projected/d12c80ac-a1e7-47e0-ac70-147bbe409805-kube-api-access-ffzxk\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-sys\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4ql\" (UniqueName: \"kubernetes.io/projected/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-kube-api-access-dr4ql\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-log-socket\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.147899 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-modprobe-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6814e71-b973-443f-b87b-975f85d20e3c-multus-daemon-config\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-var-lib-kubelet\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-var-lib-kubelet\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-bin\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-kubernetes\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-kubelet-config\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a079510b-d28d-4970-b93c-3460728b05d4-serviceca\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147154 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-node-log\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-cnibin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-run-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147228 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147221 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-cnibin\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-kubernetes\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.148657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-host-cni-bin\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c36f9-752c-45a6-98d4-e0af9ca5ec65-kubelet-config\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-config\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.147398 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-sys\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.147458 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:53.647440123 +0000 UTC m=+3.018406932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147537 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-socket-dir\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147573 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147578 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-log-socket\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxvw\" (UniqueName: \"kubernetes.io/projected/a6814e71-b973-443f-b87b-975f85d20e3c-kube-api-access-mmxvw\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-lib-modules\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-modprobe-d\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8k9\" (UniqueName: \"kubernetes.io/projected/f6fd891a-dc19-4cfa-99fd-9785861e0865-kube-api-access-9j8k9\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-systemd-units\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-sys-fs\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:53.149440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-system-cni-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zdk\" (UniqueName: \"kubernetes.io/projected/f865f6e2-2201-457e-b4f9-2978235da0b7-kube-api-access-87zdk\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-konnectivity-ca\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-os-release\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-socket-dir-parent\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6fd891a-dc19-4cfa-99fd-9785861e0865-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147894 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-system-cni-dir\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9l6m\" (UniqueName: \"kubernetes.io/projected/70172f5d-eab0-4b97-8058-5361e0ea20c1-kube-api-access-w9l6m\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-var-lib-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-multus-socket-dir-parent\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50eefe5b-80d0-4590-be39-a7f07ed822d8-tmp-dir\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.147993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-cnibin\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-script-lib\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-sysctl-conf\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-var-lib-openvswitch\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-os-release\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6fd891a-dc19-4cfa-99fd-9785861e0865-cnibin\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.150178 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a079510b-d28d-4970-b93c-3460728b05d4-host\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12c80ac-a1e7-47e0-ac70-147bbe409805-systemd-units\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-konnectivity-ca\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.148453 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovnkube-script-lib\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.146465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6814e71-b973-443f-b87b-975f85d20e3c-host-var-lib-cni-multus\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.149724 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-tmp\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.149853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12c80ac-a1e7-47e0-ac70-147bbe409805-ovn-node-metrics-cert\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.150953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.150918 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f865f6e2-2201-457e-b4f9-2978235da0b7-etc-tuned\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.151260 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.151183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d903400e-d3af-4f81-af5d-d9c4b2b8ddba-agent-certs\") pod \"konnectivity-agent-2pb6w\" (UID: \"d903400e-d3af-4f81-af5d-d9c4b2b8ddba\") " pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.153697 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.153680 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgr9\" (UniqueName: \"kubernetes.io/projected/a079510b-d28d-4970-b93c-3460728b05d4-kube-api-access-qvgr9\") pod \"node-ca-v8j88\" (UID: \"a079510b-d28d-4970-b93c-3460728b05d4\") " pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.154171 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.154150 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxtb8\" (UniqueName: \"kubernetes.io/projected/4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d-kube-api-access-dxtb8\") pod \"aws-ebs-csi-driver-node-pj79k\" (UID: \"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.155576 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.155553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzxk\" (UniqueName: \"kubernetes.io/projected/d12c80ac-a1e7-47e0-ac70-147bbe409805-kube-api-access-ffzxk\") pod \"ovnkube-node-wp76d\" (UID: \"d12c80ac-a1e7-47e0-ac70-147bbe409805\") " pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.156157 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.156137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8k9\" (UniqueName: \"kubernetes.io/projected/f6fd891a-dc19-4cfa-99fd-9785861e0865-kube-api-access-9j8k9\") pod \"multus-additional-cni-plugins-47hhq\" (UID: \"f6fd891a-dc19-4cfa-99fd-9785861e0865\") " pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.156533 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.156512 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zdk\" (UniqueName: \"kubernetes.io/projected/f865f6e2-2201-457e-b4f9-2978235da0b7-kube-api-access-87zdk\") pod \"tuned-b494h\" (UID: \"f865f6e2-2201-457e-b4f9-2978235da0b7\") " pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.156676 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.156661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxvw\" (UniqueName: \"kubernetes.io/projected/a6814e71-b973-443f-b87b-975f85d20e3c-kube-api-access-mmxvw\") pod \"multus-bkt4s\" (UID: \"a6814e71-b973-443f-b87b-975f85d20e3c\") " pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.249064 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72whl\" (UniqueName: \"kubernetes.io/projected/50eefe5b-80d0-4590-be39-a7f07ed822d8-kube-api-access-72whl\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.249221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-iptables-alerter-script\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.249221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50eefe5b-80d0-4590-be39-a7f07ed822d8-hosts-file\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.249221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4ql\" (UniqueName: \"kubernetes.io/projected/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-kube-api-access-dr4ql\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.249221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:53.249221 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9l6m\" (UniqueName: \"kubernetes.io/projected/70172f5d-eab0-4b97-8058-5361e0ea20c1-kube-api-access-w9l6m\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50eefe5b-80d0-4590-be39-a7f07ed822d8-tmp-dir\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50eefe5b-80d0-4590-be39-a7f07ed822d8-hosts-file\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-host-slash\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249327 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-host-slash\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.249449 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.249403 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:53.249669 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.249458 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:53.749442899 +0000 UTC m=+3.120409713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:53.249669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50eefe5b-80d0-4590-be39-a7f07ed822d8-tmp-dir\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.249669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.249606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-iptables-alerter-script\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.252072 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.252055 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:53.257497 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.257476 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:53.257497 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.257500 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:53.257647 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.257515 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:53.257647 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.257578 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:53.757562611 +0000 UTC m=+3.128529422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:53.258063 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.258043 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72whl\" (UniqueName: \"kubernetes.io/projected/50eefe5b-80d0-4590-be39-a7f07ed822d8-kube-api-access-72whl\") pod \"node-resolver-vxq87\" (UID: \"50eefe5b-80d0-4590-be39-a7f07ed822d8\") " pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.259523 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.259501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4ql\" (UniqueName: \"kubernetes.io/projected/81d042ac-9f19-4c6e-b011-b6b6abe26aa4-kube-api-access-dr4ql\") pod \"iptables-alerter-jj9lw\" (UID: \"81d042ac-9f19-4c6e-b011-b6b6abe26aa4\") " pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.261418 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.261401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9l6m\" (UniqueName: \"kubernetes.io/projected/70172f5d-eab0-4b97-8058-5361e0ea20c1-kube-api-access-w9l6m\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.345397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.345314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkt4s" Jul 31 14:47:53.354248 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.354098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:47:53.362601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.362580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" Jul 31 14:47:53.369024 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.369006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b494h" Jul 31 14:47:53.376402 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.376385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v8j88" Jul 31 14:47:53.382695 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.382675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:47:53.388998 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.388979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-47hhq" Jul 31 14:47:53.396291 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.396271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxq87" Jul 31 14:47:53.403585 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.403566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jj9lw" Jul 31 14:47:53.652207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.652124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:53.652378 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.652246 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:53.652378 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.652305 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:54.652286621 +0000 UTC m=+4.023253444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:53.753491 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.753456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:53.753656 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.753581 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:53.753656 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.753644 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:54.753631136 +0000 UTC m=+4.124597946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:53.854633 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:53.854596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:53.854792 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.854755 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:53.854831 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.854795 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:53.854831 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.854805 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:53.854897 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:53.854853 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:54.854839042 +0000 UTC m=+4.225805850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:54.082865 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.082788 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:42:53 +0000 UTC" deadline="2028-04-18 11:25:28.583258972 +0000 UTC" Jul 31 14:47:54.082865 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.082818 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15044h37m34.500443897s" Jul 31 14:47:54.098164 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.098132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:54.098310 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.098263 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:47:54.175708 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.175684 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:54.225342 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.225272 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf865f6e2_2201_457e_b4f9_2978235da0b7.slice/crio-06786395f8ea2c090888e7ea5c957e65e80cb61c5bd824ccc9f7c4ef510a2325 WatchSource:0}: Error finding container 06786395f8ea2c090888e7ea5c957e65e80cb61c5bd824ccc9f7c4ef510a2325: Status 404 returned error can't find the container with id 06786395f8ea2c090888e7ea5c957e65e80cb61c5bd824ccc9f7c4ef510a2325 Jul 31 14:47:54.227398 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.227283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12c80ac_a1e7_47e0_ac70_147bbe409805.slice/crio-5f99665f4fa9de76eb6fd796a55db6a97f48f0755d15728a69018460fde6ea65 WatchSource:0}: Error finding container 5f99665f4fa9de76eb6fd796a55db6a97f48f0755d15728a69018460fde6ea65: Status 404 returned error can't find the container with id 5f99665f4fa9de76eb6fd796a55db6a97f48f0755d15728a69018460fde6ea65 Jul 31 14:47:54.230704 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.230681 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50eefe5b_80d0_4590_be39_a7f07ed822d8.slice/crio-10e581821f725a91882242718f147a0482760a6e51582f42507b49e969d439e2 WatchSource:0}: Error finding container 10e581821f725a91882242718f147a0482760a6e51582f42507b49e969d439e2: Status 404 returned error can't find the container with id 10e581821f725a91882242718f147a0482760a6e51582f42507b49e969d439e2 Jul 31 14:47:54.231316 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.231293 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda079510b_d28d_4970_b93c_3460728b05d4.slice/crio-5fdcb6556c3df89f6c4a0de79c78588e582a08f33fea35d077f80bffda2615b1 WatchSource:0}: Error finding container 5fdcb6556c3df89f6c4a0de79c78588e582a08f33fea35d077f80bffda2615b1: Status 404 returned error can't find the container with id 5fdcb6556c3df89f6c4a0de79c78588e582a08f33fea35d077f80bffda2615b1 Jul 31 14:47:54.232807 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.232573 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d042ac_9f19_4c6e_b011_b6b6abe26aa4.slice/crio-b5e70449f0ad8893b2aa59d29e7ec5020c558010504419c23d8f9b459f4c5c60 WatchSource:0}: Error finding container b5e70449f0ad8893b2aa59d29e7ec5020c558010504419c23d8f9b459f4c5c60: Status 404 returned error can't find the container with id b5e70449f0ad8893b2aa59d29e7ec5020c558010504419c23d8f9b459f4c5c60 Jul 31 14:47:54.234322 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.234188 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfa0b74_8c6f_4559_afb4_2ccf6d305b3d.slice/crio-6300b9eba66c205f90b129ca2850b09ffffcf5b1362f20d476162470440d45c1 WatchSource:0}: Error finding container 6300b9eba66c205f90b129ca2850b09ffffcf5b1362f20d476162470440d45c1: Status 404 returned error can't find the container with id 6300b9eba66c205f90b129ca2850b09ffffcf5b1362f20d476162470440d45c1 Jul 31 14:47:54.234510 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.234476 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fd891a_dc19_4cfa_99fd_9785861e0865.slice/crio-4e40b98725cfb3648db68f86cb114a7bb387e9800017fc29f2f7f6f61beb36ab WatchSource:0}: Error finding container 4e40b98725cfb3648db68f86cb114a7bb387e9800017fc29f2f7f6f61beb36ab: Status 404 returned error can't find the container with id 4e40b98725cfb3648db68f86cb114a7bb387e9800017fc29f2f7f6f61beb36ab Jul 31 14:47:54.235280 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:47:54.234944 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6814e71_b973_443f_b87b_975f85d20e3c.slice/crio-ce49191a20989554b6451fdb6ca460dadf12e597a09830a7677d0a969857efab WatchSource:0}: Error finding container ce49191a20989554b6451fdb6ca460dadf12e597a09830a7677d0a969857efab: Status 404 returned error can't find the container with id ce49191a20989554b6451fdb6ca460dadf12e597a09830a7677d0a969857efab Jul 31 14:47:54.661793 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.661519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:54.661958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.661678 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:54.661958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.661940 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:56.661920939 +0000 UTC m=+6.032887751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:54.736583 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.736229 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:54.763505 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.762952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:54.763505 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.763134 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:54.763505 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.763200 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:56.763180916 +0000 UTC m=+6.134147730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:54.864111 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:54.863400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:54.864111 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.863582 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:54.864111 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.863613 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:54.864111 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.863631 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:54.864111 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:54.863692 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:56.863672927 +0000 UTC m=+6.234639741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:55.083632 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.083527 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:42:53 +0000 UTC" deadline="2028-03-04 11:22:17.603895655 +0000 UTC" Jul 31 14:47:55.083632 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.083590 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13964h34m22.520310053s" Jul 31 14:47:55.116380 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.115942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:55.116380 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:55.116058 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:47:55.116380 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.116116 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:55.116380 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:55.116248 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:47:55.128573 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.128066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" event={"ID":"0e504157da6704e201008e686b90b4bd","Type":"ContainerStarted","Data":"8d7cafd0caa16f6622494781617bb9a1b0fd38e17487feaa3770110a48927482"} Jul 31 14:47:55.132244 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.132150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pb6w" event={"ID":"d903400e-d3af-4f81-af5d-d9c4b2b8ddba","Type":"ContainerStarted","Data":"2fa3cf0722558af597f6a10f59eaf758adb0c1bffac2d68fa8f7b5dabd780d4e"} Jul 31 14:47:55.135832 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.135809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerStarted","Data":"4e40b98725cfb3648db68f86cb114a7bb387e9800017fc29f2f7f6f61beb36ab"} Jul 31 14:47:55.141092 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.141069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" event={"ID":"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d","Type":"ContainerStarted","Data":"6300b9eba66c205f90b129ca2850b09ffffcf5b1362f20d476162470440d45c1"} Jul 31 14:47:55.144543 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.144518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj9lw" event={"ID":"81d042ac-9f19-4c6e-b011-b6b6abe26aa4","Type":"ContainerStarted","Data":"b5e70449f0ad8893b2aa59d29e7ec5020c558010504419c23d8f9b459f4c5c60"} Jul 31 14:47:55.163057 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.163028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v8j88" event={"ID":"a079510b-d28d-4970-b93c-3460728b05d4","Type":"ContainerStarted","Data":"5fdcb6556c3df89f6c4a0de79c78588e582a08f33fea35d077f80bffda2615b1"} Jul 31 14:47:55.167743 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.167718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"5f99665f4fa9de76eb6fd796a55db6a97f48f0755d15728a69018460fde6ea65"} Jul 31 14:47:55.174787 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.170451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b494h" event={"ID":"f865f6e2-2201-457e-b4f9-2978235da0b7","Type":"ContainerStarted","Data":"06786395f8ea2c090888e7ea5c957e65e80cb61c5bd824ccc9f7c4ef510a2325"} Jul 31 14:47:55.180785 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.175369 2564 generic.go:356] "Generic (PLEG): container finished" podID="d090ab9441b0c1810580b6868e0caf4c" containerID="91f47463661613dd39bff9d27bc856b5cb2e78be874b61879455341c062be47c" exitCode=0 Jul 31 14:47:55.180785 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.175612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" event={"ID":"d090ab9441b0c1810580b6868e0caf4c","Type":"ContainerDied","Data":"91f47463661613dd39bff9d27bc856b5cb2e78be874b61879455341c062be47c"} Jul 31 14:47:55.194835 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.194053 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-97.ec2.internal" podStartSLOduration=3.194034487 podStartE2EDuration="3.194034487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:55.143864505 +0000 UTC m=+4.514831339" watchObservedRunningTime="2026-07-31 14:47:55.194034487 +0000 UTC m=+4.565001318" Jul 31 14:47:55.206458 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.206239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkt4s" event={"ID":"a6814e71-b973-443f-b87b-975f85d20e3c","Type":"ContainerStarted","Data":"ce49191a20989554b6451fdb6ca460dadf12e597a09830a7677d0a969857efab"} Jul 31 14:47:55.216431 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:55.216403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxq87" event={"ID":"50eefe5b-80d0-4590-be39-a7f07ed822d8","Type":"ContainerStarted","Data":"10e581821f725a91882242718f147a0482760a6e51582f42507b49e969d439e2"} Jul 31 14:47:56.098933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:56.098391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:56.098933 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.098514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:47:56.230248 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:56.230212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" event={"ID":"d090ab9441b0c1810580b6868e0caf4c","Type":"ContainerStarted","Data":"e092709b19a9c86e0be52947ff42d135ae1b59cef2c152ac164ea6fc4ffbda77"} Jul 31 14:47:56.679244 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:56.679207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:56.679435 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.679405 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:56.679497 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.679468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:00.679450607 +0000 UTC m=+10.050417429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:56.780151 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:56.780115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:56.780317 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.780263 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:56.780395 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.780325 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:00.780307224 +0000 UTC m=+10.151274038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:56.881263 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:56.881223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:56.881470 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.881371 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:56.881470 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.881388 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:56.881470 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.881400 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:56.881470 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:56.881455 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:00.88143685 +0000 UTC m=+10.252403664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:57.100297 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:57.098047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:57.100297 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:57.098179 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:47:57.100297 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:57.098589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:57.100297 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:57.098684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:47:58.097698 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:58.097666 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:47:58.097867 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:58.097792 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:47:59.102222 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:59.102194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:47:59.102702 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:59.102323 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:47:59.102702 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:47:59.102376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:47:59.102702 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:47:59.102496 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:00.098747 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:00.098663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:00.098921 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.098811 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:00.714456 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:00.713874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:00.714456 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.714068 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:00.714456 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.714136 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.714116716 +0000 UTC m=+18.085083542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:00.814857 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:00.814818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:00.815039 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.814973 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:00.815039 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.815032 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.815017029 +0000 UTC m=+18.185983841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:00.915224 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:00.915187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:00.915405 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.915340 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:00.915405 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.915363 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:00.915405 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.915372 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:00.915571 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:00.915413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:08.915400932 +0000 UTC m=+18.286367741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:01.099458 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:01.098803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:01.099458 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:01.098900 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:01.099458 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:01.098959 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:01.099458 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:01.099046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:02.098180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:02.098142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:02.098673 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:02.098281 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:03.097988 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:03.097955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:03.098136 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:03.098075 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:03.098490 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:03.098470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:03.098852 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:03.098579 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:04.098191 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:04.098159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:04.098373 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:04.098289 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:05.098446 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:05.098372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:05.098845 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:05.098372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:05.098845 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:05.098508 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:05.098845 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:05.098605 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:06.098738 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:06.098698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:06.099196 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:06.098842 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:07.098759 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:07.098727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:07.099233 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:07.098879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:07.099233 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:07.098933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:07.099233 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:07.099043 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:08.098218 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:08.098190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:08.098397 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.098311 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:08.776841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:08.776737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:08.777284 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.776898 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:08.777284 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.776983 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:24.776953952 +0000 UTC m=+34.147920761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:08.877314 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:08.877239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:08.877493 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.877414 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:08.877493 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.877493 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:24.877472636 +0000 UTC m=+34.248439450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:08.978039 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:08.978006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:08.978207 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.978165 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:08.978207 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.978185 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:08.978207 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.978195 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:08.978334 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:08.978248 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:24.978231236 +0000 UTC m=+34.349198046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:09.098311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:09.098222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:09.098311 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:09.098247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:09.098521 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:09.098352 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:09.098521 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:09.098497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:10.098400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:10.098366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:10.098829 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:10.098482 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:11.099206 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:11.098688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:11.099206 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:11.098752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:11.099206 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:11.098834 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:11.099206 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:11.098923 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:12.097748 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:12.097718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:12.097933 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:12.097870 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:13.098934 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.098632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:13.099487 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.098707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:13.099487 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:13.099012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:13.099487 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:13.099105 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:13.270737 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.270705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b494h" event={"ID":"f865f6e2-2201-457e-b4f9-2978235da0b7","Type":"ContainerStarted","Data":"2d7c14bedbe12e8ca659af29d0ec760a0fa8ae374986444bee5394b302fa879e"} Jul 31 14:48:13.271896 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.271876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkt4s" event={"ID":"a6814e71-b973-443f-b87b-975f85d20e3c","Type":"ContainerStarted","Data":"fe74cb340a22793e169a31c37defcd58d11b27bdbeebb5e7c2fd60b46c9e7ed5"} Jul 31 14:48:13.272957 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.272939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxq87" event={"ID":"50eefe5b-80d0-4590-be39-a7f07ed822d8","Type":"ContainerStarted","Data":"1f1a1369c546e7de06de0fc9e7b9ac4b6d9cf6046de94deb0eb8a18fe5f33b7a"} Jul 31 14:48:13.274309 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.274290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pb6w" event={"ID":"d903400e-d3af-4f81-af5d-d9c4b2b8ddba","Type":"ContainerStarted","Data":"8931e8b933c8880a988232821578f8e4e7fc94922a49950ff575ef1c8eb0176b"} Jul 31 14:48:13.275735 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.275714 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="f49605d73d55c2e3627204176b0bd8a10b9c23d1000edf2c384c61563d96cebe" exitCode=0 Jul 31 14:48:13.275825 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.275804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"f49605d73d55c2e3627204176b0bd8a10b9c23d1000edf2c384c61563d96cebe"} Jul 31 14:48:13.277327 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.277307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" event={"ID":"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d","Type":"ContainerStarted","Data":"7cc732f4d1fa7b88dccf5c9c35d2fbd8c9c5d2d5ebe36c8a1b378942869f0016"} Jul 31 14:48:13.278809 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.278768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v8j88" event={"ID":"a079510b-d28d-4970-b93c-3460728b05d4","Type":"ContainerStarted","Data":"43ec869d0a359a71d9905a873cdd5990eb21267df965d15d3e7b2da1536ad793"} Jul 31 14:48:13.281323 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.281303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"58000d0710373b4d54618b70174d8964f6059bf08d50ff96ab2b9999dfbaea41"} Jul 31 14:48:13.281414 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.281374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"390baa9648e5265ec78aeb11dd3f5bddc3a1ed5f909ec8e7818078bf43e5e72f"} Jul 31 14:48:13.281463 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.281422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"5716ebf4a9756524cb1a538c61473549aea3296c22fc2bcbd9ef9179f3dcbc74"} Jul 31 14:48:13.281502 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.281467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"ad75eb9505de01dceb2d8b2e88cab43ced406e94dd5625e9c74a55259be28518"} Jul 31 14:48:13.281576 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.281513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"130bfb2787e6ebfb786b3092deb824a3a59c4cce1d66f0f72afd358a5e358476"} Jul 31 14:48:13.304435 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.304374 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-97.ec2.internal" podStartSLOduration=21.304354526 podStartE2EDuration="21.304354526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:56.247628499 +0000 UTC m=+5.618595331" watchObservedRunningTime="2026-07-31 14:48:13.304354526 +0000 UTC m=+22.675321357" Jul 31 14:48:13.327573 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.327527 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bkt4s" podStartSLOduration=3.841713813 podStartE2EDuration="22.327509478s" totalImagesPullingTime="18.485795665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:13.304553309 +0000 UTC m=+22.675520141" watchObservedRunningTime="2026-07-31 14:48:13.327509478 +0000 UTC m=+22.698476314" Jul 31 14:48:13.341383 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.341345 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b494h" podStartSLOduration=3.919215056 podStartE2EDuration="22.341331098s" totalImagesPullingTime="18.422116042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:13.327422953 +0000 UTC m=+22.698389784" watchObservedRunningTime="2026-07-31 14:48:13.341331098 +0000 UTC m=+22.712297930" Jul 31 14:48:13.341488 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.341429 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v8j88" podStartSLOduration=3.930250052 podStartE2EDuration="22.341424822s" totalImagesPullingTime="18.41117477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:13.341315974 +0000 UTC m=+22.712282805" watchObservedRunningTime="2026-07-31 14:48:13.341424822 +0000 UTC m=+22.712391656" Jul 31 14:48:13.412575 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:13.412485 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2pb6w" podStartSLOduration=8.242144689 podStartE2EDuration="22.412469809s" totalImagesPullingTime="14.17032512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:13.39128668 +0000 UTC m=+22.762253511" watchObservedRunningTime="2026-07-31 14:48:13.412469809 +0000 UTC m=+22.783436640" Jul 31 14:48:14.098725 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.098687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:14.098942 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:14.098883 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:14.244195 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.244169 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 14:48:14.285863 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.285818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" event={"ID":"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d","Type":"ContainerStarted","Data":"862cb8af449c4dfb1d45a538a484097403251e48ca958f04301e3468f84f3247"} Jul 31 14:48:14.287495 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.287467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jj9lw" event={"ID":"81d042ac-9f19-4c6e-b011-b6b6abe26aa4","Type":"ContainerStarted","Data":"aa466999f89b021c8e9813c49c693771326ec3851c2f53ccba27a7d8ee0ce417"} Jul 31 14:48:14.291293 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.290954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"e9f1e7f08fb3c6cdcbefa57b06908590e0e75a0145c15a3de7179ea8400cf6aa"} Jul 31 14:48:14.304616 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.304565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vxq87" podStartSLOduration=4.891305845 podStartE2EDuration="23.304550499s" totalImagesPullingTime="18.413244654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:13.412766551 +0000 UTC m=+22.783733382" watchObservedRunningTime="2026-07-31 14:48:14.304550499 +0000 UTC m=+23.675517331" Jul 31 14:48:14.304806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:14.304756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jj9lw" podStartSLOduration=4.890511308 podStartE2EDuration="23.304747741s" totalImagesPullingTime="18.414236433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:14.304496096 +0000 UTC m=+23.675462931" watchObservedRunningTime="2026-07-31 14:48:14.304747741 +0000 UTC m=+23.675714573" Jul 31 14:48:15.098502 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.098468 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:15.098918 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:15.098597 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:15.098918 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.098653 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:15.098918 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:15.098821 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:15.106590 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.106514 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T14:48:14.244190917Z","UUID":"660899bc-d7b1-49e2-abaf-249930445313","Handler":null,"Name":"","Endpoint":""} Jul 31 14:48:15.109333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.109311 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 14:48:15.109449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.109346 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 14:48:15.247844 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.247815 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:48:15.393646 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.393567 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:48:15.394282 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:15.394262 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:48:16.098631 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:16.098596 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:16.098833 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:16.098722 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:16.298088 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:16.298050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"cb052c1e0c652854185f898fc6ecbcf4dbd475f27829ae559707021128482b69"} Jul 31 14:48:16.298765 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:16.298747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2pb6w" Jul 31 14:48:17.098997 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:17.098736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:17.099166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:17.098823 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:17.099166 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:17.099096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:17.099279 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:17.099179 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:18.098703 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.098678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:18.099460 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:18.098811 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:18.303828 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.303633 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="4bb989a0fddb9c0c6465f74eb9561f807b1d03b271f32976bae441f4d76e9c34" exitCode=0 Jul 31 14:48:18.303962 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.303711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"4bb989a0fddb9c0c6465f74eb9561f807b1d03b271f32976bae441f4d76e9c34"} Jul 31 14:48:18.306003 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.305984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" event={"ID":"4cfa0b74-8c6f-4559-afb4-2ccf6d305b3d","Type":"ContainerStarted","Data":"7d9c1a39eb2ff8e705631ed1b177d2490ddd172775df0501a494c504a874727d"} Jul 31 14:48:18.309665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.309643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" event={"ID":"d12c80ac-a1e7-47e0-ac70-147bbe409805","Type":"ContainerStarted","Data":"a966ef0868a92d25e5ceec60b3f160f2dfac45b567f6aa3dad8b259454ef26cb"} Jul 31 14:48:18.310031 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.310010 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:18.310116 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.310069 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:18.310116 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.310106 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:18.324439 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.324420 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:18.327496 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.327478 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:18.358827 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.358759 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" podStartSLOduration=8.871331802 podStartE2EDuration="27.358746146s" totalImagesPullingTime="18.487414344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:18.358294441 +0000 UTC m=+27.729261265" watchObservedRunningTime="2026-07-31 14:48:18.358746146 +0000 UTC m=+27.729712976" Jul 31 14:48:18.377436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:18.376212 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pj79k" podStartSLOduration=4.069702264 podStartE2EDuration="27.376194665s" totalImagesPullingTime="23.306492401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:18.375513257 +0000 UTC m=+27.746480100" watchObservedRunningTime="2026-07-31 14:48:18.376194665 +0000 UTC m=+27.747161497" Jul 31 14:48:19.098241 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:19.098213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:19.098430 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:19.098245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:19.098430 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:19.098349 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:19.098525 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:19.098449 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:20.098404 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.098341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:20.098817 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:20.098439 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:20.295005 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.294967 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zt6tc"] Jul 31 14:48:20.295149 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.295100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:20.295246 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:20.295223 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:20.297047 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.297023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cs8rz"] Jul 31 14:48:20.299605 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.299586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgnw9"] Jul 31 14:48:20.299704 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.299650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:20.299761 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:20.299722 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:20.317601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.317570 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="afe4719579f8034b505fa3731f50979b0ec8ce56c8c1cafaec8b0186632d0e1e" exitCode=0 Jul 31 14:48:20.317730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.317655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"afe4719579f8034b505fa3731f50979b0ec8ce56c8c1cafaec8b0186632d0e1e"} Jul 31 14:48:20.317795 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:20.317752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:20.317909 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:20.317879 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:22.098185 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:22.098154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:22.098578 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:22.098262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:22.098578 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:22.098275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:22.098578 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:22.098290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:22.098578 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:22.098373 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:22.098578 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:22.098448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:22.323699 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:22.323538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerStarted","Data":"25146d8a29593c5d5181f466bf2678509d5c12775b5915a1d90b7f1e9d474ebd"} Jul 31 14:48:23.327940 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:23.327907 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="25146d8a29593c5d5181f466bf2678509d5c12775b5915a1d90b7f1e9d474ebd" exitCode=0 Jul 31 14:48:23.328426 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:23.327961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"25146d8a29593c5d5181f466bf2678509d5c12775b5915a1d90b7f1e9d474ebd"} Jul 31 14:48:24.099240 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.098471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:24.099240 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.098508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:24.099240 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.098518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:24.099240 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.098604 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgnw9" podUID="e9e09a90-8808-441e-a66b-494c8d5352a5" Jul 31 14:48:24.101295 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.099606 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cs8rz" podUID="866c36f9-752c-45a6-98d4-e0af9ca5ec65" Jul 31 14:48:24.101295 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.100028 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zt6tc" podUID="70172f5d-eab0-4b97-8058-5361e0ea20c1" Jul 31 14:48:24.789559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.789526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:24.790014 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.789653 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:24.790014 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.789719 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret podName:866c36f9-752c-45a6-98d4-e0af9ca5ec65 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.78970192 +0000 UTC m=+66.160668735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret") pod "global-pull-secret-syncer-cs8rz" (UID: "866c36f9-752c-45a6-98d4-e0af9ca5ec65") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:48:24.890227 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.890196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:24.890409 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.890325 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:24.890409 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.890393 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.89037469 +0000 UTC m=+66.261341505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:48:24.990636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:24.990596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:24.990835 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.990732 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:48:24.990835 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.990751 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:48:24.990835 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.990763 2564 projected.go:196] Error preparing data for projected volume kube-api-access-77m6c for pod openshift-network-diagnostics/network-check-target-kgnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:24.991007 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:24.990839 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c podName:e9e09a90-8808-441e-a66b-494c8d5352a5 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.99082249 +0000 UTC m=+66.361789316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-77m6c" (UniqueName: "kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c") pod "network-check-target-kgnw9" (UID: "e9e09a90-8808-441e-a66b-494c8d5352a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:48:25.477175 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.477097 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-97.ec2.internal" event="NodeReady" Jul 31 14:48:25.477404 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.477256 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 14:48:25.522452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.522421 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:48:25.526302 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.526270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.530598 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.530435 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 14:48:25.530598 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.530506 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8rc5\"" Jul 31 14:48:25.530598 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.530528 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 14:48:25.531657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.531635 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 14:48:25.539147 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.539127 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 14:48:25.539256 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.539149 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r6hsm"] Jul 31 14:48:25.543578 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.543238 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zjt7z"] Jul 31 14:48:25.543902 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.543884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.546658 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.546638 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-plcv4\"" Jul 31 14:48:25.546786 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.546752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 14:48:25.547188 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.547174 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:48:25.547251 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.547241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.551346 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.551321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p85t9\"" Jul 31 14:48:25.551433 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.551326 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 14:48:25.551433 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.551400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 14:48:25.551556 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.551444 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 14:48:25.551724 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.551707 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 14:48:25.556954 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.556903 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zjt7z"] Jul 31 14:48:25.565055 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.565034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6hsm"] Jul 31 14:48:25.668223 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.668191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:25.695581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcts\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.695581 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-config-volume\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.695820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-tmp-dir\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.695820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.695820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.695820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh4dq\" (UniqueName: \"kubernetes.io/projected/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-kube-api-access-qh4dq\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bcc543-a23c-4a00-be94-d971978c57c4-cert\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.695998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.696027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.696026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twzmp\" (UniqueName: \"kubernetes.io/projected/52bcc543-a23c-4a00-be94-d971978c57c4-kube-api-access-twzmp\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.696258 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.696049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.756397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.756321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:25.797338 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcts\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.797338 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-config-volume\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-tmp-dir\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:25.797557 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:25.797576 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:25.797652 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:26.297614642 +0000 UTC m=+35.668581454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-tmp-dir\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh4dq\" (UniqueName: \"kubernetes.io/projected/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-kube-api-access-qh4dq\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bcc543-a23c-4a00-be94-d971978c57c4-cert\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.797862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797963 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-config-volume\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.797992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twzmp\" (UniqueName: \"kubernetes.io/projected/52bcc543-a23c-4a00-be94-d971978c57c4-kube-api-access-twzmp\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.798362 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.798688 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798688 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.798688 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:25.798668 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:25.798868 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:25.798719 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:26.298701932 +0000 UTC m=+35.669668752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:25.799013 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.798989 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.802017 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.801996 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.802123 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.802070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.802209 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.802190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bcc543-a23c-4a00-be94-d971978c57c4-cert\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.812318 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.812292 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.812904 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.812884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcts\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:25.813087 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.813068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twzmp\" (UniqueName: \"kubernetes.io/projected/52bcc543-a23c-4a00-be94-d971978c57c4-kube-api-access-twzmp\") pod \"ingress-canary-zjt7z\" (UID: \"52bcc543-a23c-4a00-be94-d971978c57c4\") " pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:25.813211 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.813189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh4dq\" (UniqueName: \"kubernetes.io/projected/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-kube-api-access-qh4dq\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:25.855760 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.855722 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:25.861548 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:25.861523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zjt7z" Jul 31 14:48:26.098198 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.098112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:26.098198 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.098146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:26.098416 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.098112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.100610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.100704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.100840 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.100923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzg7\"" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.101046 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wtnft\"" Jul 31 14:48:26.101190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.101135 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:48:26.302856 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.302817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:26.303037 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.302902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:26.303037 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:26.302942 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:26.303037 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:26.302993 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:26.303037 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:26.303008 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:26.303037 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:26.303013 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:27.302991422 +0000 UTC m=+36.673958245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:26.303249 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:26.303043 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:27.303030157 +0000 UTC m=+36.673996983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:26.546322 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.546230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:26.683434 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.683389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:26.857426 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.857337 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:26.930388 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:26.930355 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:27.160785 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:27.160687 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:27.267147 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:27.267096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:27.310674 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:27.310634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:27.310842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:27.310723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:27.310919 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:27.310846 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:27.310919 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:27.310886 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:27.311029 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:27.310964 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:29.310927849 +0000 UTC m=+38.681894670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:27.311622 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:27.310847 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:27.311622 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:27.311587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:29.311553651 +0000 UTC m=+38.682520460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:27.387788 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:27.387626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zjt7z"] Jul 31 14:48:27.391634 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:48:27.391604 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bcc543_a23c_4a00_be94_d971978c57c4.slice/crio-a8c24048da18f0a8640fa9d4ee3c1f91ddb0969108b7f8813ecfdd430477836e WatchSource:0}: Error finding container a8c24048da18f0a8640fa9d4ee3c1f91ddb0969108b7f8813ecfdd430477836e: Status 404 returned error can't find the container with id a8c24048da18f0a8640fa9d4ee3c1f91ddb0969108b7f8813ecfdd430477836e Jul 31 14:48:28.345877 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:28.345843 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="4fe947729b7bc2c4d84f823fd574514a528ef090309d320a749f0efa4ad98d6c" exitCode=0 Jul 31 14:48:28.346638 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:28.345971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"4fe947729b7bc2c4d84f823fd574514a528ef090309d320a749f0efa4ad98d6c"} Jul 31 14:48:28.347173 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:28.347060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zjt7z" event={"ID":"52bcc543-a23c-4a00-be94-d971978c57c4","Type":"ContainerStarted","Data":"a8c24048da18f0a8640fa9d4ee3c1f91ddb0969108b7f8813ecfdd430477836e"} Jul 31 14:48:29.327136 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:29.327095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:29.327363 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:29.327196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:29.327363 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:29.327297 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:29.327363 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:29.327319 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:29.327363 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:29.327339 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:29.327522 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:29.327386 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:33.327362151 +0000 UTC m=+42.698328974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:29.327522 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:29.327409 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:33.327399114 +0000 UTC m=+42.698365925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:29.353283 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:29.353253 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6fd891a-dc19-4cfa-99fd-9785861e0865" containerID="e666a2040108d04ad815839788b70abc4fb8d60ce515bd9b6a5cdb7cdda6ae67" exitCode=0 Jul 31 14:48:29.353732 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:29.353308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerDied","Data":"e666a2040108d04ad815839788b70abc4fb8d60ce515bd9b6a5cdb7cdda6ae67"} Jul 31 14:48:29.942188 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:29.942151 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:30.356551 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.356518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zjt7z" event={"ID":"52bcc543-a23c-4a00-be94-d971978c57c4","Type":"ContainerStarted","Data":"a90c3ed10787689c7cc2956c7ada8cc5069dc091d19e0e206b086f67ba91ecc0"} Jul 31 14:48:30.359587 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.359560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47hhq" event={"ID":"f6fd891a-dc19-4cfa-99fd-9785861e0865","Type":"ContainerStarted","Data":"748f5a556c893f8e7f86e9e6a4f4b0d4f7455a00e740dc45568800a0bf1b1aec"} Jul 31 14:48:30.386091 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.386046 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zjt7z" podStartSLOduration=2.888522596 podStartE2EDuration="5.386030319s" totalImagesPullingTime="2.497507723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:30.385933167 +0000 UTC m=+39.756899998" watchObservedRunningTime="2026-07-31 14:48:30.386030319 +0000 UTC m=+39.756997146" Jul 31 14:48:30.413982 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.413943 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-47hhq" podStartSLOduration=9.406576193 podStartE2EDuration="39.413929552s" totalImagesPullingTime="30.007353359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:30.41334719 +0000 UTC m=+39.784314042" watchObservedRunningTime="2026-07-31 14:48:30.413929552 +0000 UTC m=+39.784896530" Jul 31 14:48:30.538954 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.538912 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:30.599108 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:30.599075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:33.354051 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:33.354010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:33.354077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:33.354171 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:33.354190 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:33.354192 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:33.354245 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.354232396 +0000 UTC m=+50.725199204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:33.354536 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:33.354259 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.354253349 +0000 UTC m=+50.725220158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:34.275538 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:34.275500 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:41.408757 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:41.408724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:41.408816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:41.408898 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:41.408935 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:41.408946 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:41.408988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:57.408956481 +0000 UTC m=+66.779923296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:41.409332 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:41.409007 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:57.408998011 +0000 UTC m=+66.779964819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:46.347336 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:46.347293 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.525783 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:47.525746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.640062 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:47.640024 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.721123 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:47.721075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.814580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:47.814469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:47.882998 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:47.882972 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.366010 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:48.365979 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.443925 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:48.443887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:48.674435 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:48.674356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:49.040396 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:49.040364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:49.115410 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:49.115380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.328947 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:50.328912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wp76d" Jul 31 14:48:50.450835 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:50.450800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.537583 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:50.537545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:50.604230 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:50.604118 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:51.332649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:51.332597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:56.817806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:56.817758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:56.820806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:56.820787 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:48:56.832336 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:56.832309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c36f9-752c-45a6-98d4-e0af9ca5ec65-original-pull-secret\") pod \"global-pull-secret-syncer-cs8rz\" (UID: \"866c36f9-752c-45a6-98d4-e0af9ca5ec65\") " pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:56.919056 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:56.919009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:48:56.921676 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:56.921659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:48:56.929602 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:56.929582 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 14:48:56.929654 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:56.929643 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs podName:70172f5d-eab0-4b97-8058-5361e0ea20c1 nodeName:}" failed. No retries permitted until 2026-07-31 14:50:00.929621938 +0000 UTC m=+130.300588752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs") pod "network-metrics-daemon-zt6tc" (UID: "70172f5d-eab0-4b97-8058-5361e0ea20c1") : secret "metrics-daemon-secret" not found Jul 31 14:48:57.017108 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.017053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cs8rz" Jul 31 14:48:57.019281 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.019258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:57.021971 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.021950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:48:57.032206 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.032187 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:48:57.042497 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.042471 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77m6c\" (UniqueName: \"kubernetes.io/projected/e9e09a90-8808-441e-a66b-494c8d5352a5-kube-api-access-77m6c\") pod \"network-check-target-kgnw9\" (UID: \"e9e09a90-8808-441e-a66b-494c8d5352a5\") " pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:57.137503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.137475 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cs8rz"] Jul 31 14:48:57.140213 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:48:57.140184 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866c36f9_752c_45a6_98d4_e0af9ca5ec65.slice/crio-84b6791bfff46a8b9944ef21dbf2af2ae04e0ee489fbc985fc5143cf431ac9f7 WatchSource:0}: Error finding container 84b6791bfff46a8b9944ef21dbf2af2ae04e0ee489fbc985fc5143cf431ac9f7: Status 404 returned error can't find the container with id 84b6791bfff46a8b9944ef21dbf2af2ae04e0ee489fbc985fc5143cf431ac9f7 Jul 31 14:48:57.325455 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.325430 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wtnft\"" Jul 31 14:48:57.332877 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.332857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:48:57.421452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.421299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:48:57.421452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.421378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:48:57.422098 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:57.421458 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:57.422098 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:57.421475 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df6577bf7-qn2tz: secret "image-registry-tls" not found Jul 31 14:48:57.422098 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:57.421501 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:57.422098 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:57.421551 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls podName:d346173c-2381-4318-8a3d-7bd134b81b69 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:29.421532091 +0000 UTC m=+98.792498921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls") pod "image-registry-7df6577bf7-qn2tz" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69") : secret "image-registry-tls" not found Jul 31 14:48:57.422098 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:48:57.421570 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls podName:ea7d0a8d-c93a-4423-8cbd-87b1ba866241 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:29.42156157 +0000 UTC m=+98.792528379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls") pod "dns-default-r6hsm" (UID: "ea7d0a8d-c93a-4423-8cbd-87b1ba866241") : secret "dns-default-metrics-tls" not found Jul 31 14:48:57.423236 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.423208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cs8rz" event={"ID":"866c36f9-752c-45a6-98d4-e0af9ca5ec65","Type":"ContainerStarted","Data":"84b6791bfff46a8b9944ef21dbf2af2ae04e0ee489fbc985fc5143cf431ac9f7"} Jul 31 14:48:57.469151 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:57.469117 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgnw9"] Jul 31 14:48:57.471583 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:48:57.471561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e09a90_8808_441e_a66b_494c8d5352a5.slice/crio-b7bdd0fb26dd78e68dbe3d2802540b48ca65cba4fb02d6c8aa8b18d0c30ac959 WatchSource:0}: Error finding container b7bdd0fb26dd78e68dbe3d2802540b48ca65cba4fb02d6c8aa8b18d0c30ac959: Status 404 returned error can't find the container with id b7bdd0fb26dd78e68dbe3d2802540b48ca65cba4fb02d6c8aa8b18d0c30ac959 Jul 31 14:48:58.034384 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:58.034348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:58.134025 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:58.133985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:58.234515 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:58.234420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:58.428373 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:58.428279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgnw9" event={"ID":"e9e09a90-8808-441e-a66b-494c8d5352a5","Type":"ContainerStarted","Data":"b7bdd0fb26dd78e68dbe3d2802540b48ca65cba4fb02d6c8aa8b18d0c30ac959"} Jul 31 14:48:59.709128 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:48:59.709092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:02.439382 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.439346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cs8rz" event={"ID":"866c36f9-752c-45a6-98d4-e0af9ca5ec65","Type":"ContainerStarted","Data":"743832d14c324a069f7c259372b26f9b991a9b05e4ffa43988a6c1da96612961"} Jul 31 14:49:02.440871 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.440844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgnw9" event={"ID":"e9e09a90-8808-441e-a66b-494c8d5352a5","Type":"ContainerStarted","Data":"8eb69ea0c011afd2263fe4a42dc5ee9d0e44e9c18e21ae5bf659a65ab184c63b"} Jul 31 14:49:02.441010 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.440993 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:49:02.466251 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.466208 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cs8rz" podStartSLOduration=66.67652369 podStartE2EDuration="1m11.466195548s" totalImagesPullingTime="4.789671858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:02.464209032 +0000 UTC m=+71.835175863" watchObservedRunningTime="2026-07-31 14:49:02.466195548 +0000 UTC m=+71.837162379" Jul 31 14:49:02.486835 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.486795 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgnw9" podStartSLOduration=67.033562738 podStartE2EDuration="1m11.486765765s" totalImagesPullingTime="4.453203027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:02.486358344 +0000 UTC m=+71.857325176" watchObservedRunningTime="2026-07-31 14:49:02.486765765 +0000 UTC m=+71.857732596" Jul 31 14:49:02.487735 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.487712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:02.592946 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:02.592910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:03.577357 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:03.577310 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:03.649160 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:03.649128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.699193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:04.699158 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:04.799622 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:04.799591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:05.518842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:05.518810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:05.623583 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:05.623555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:13.780945 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.780834 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-77f9449df4-bp57p"] Jul 31 14:49:13.783675 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.783659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.786136 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.786112 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 31 14:49:13.786136 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.786131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 31 14:49:13.786282 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.786204 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 31 14:49:13.786577 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.786563 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-46d29\"" Jul 31 14:49:13.786848 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.786833 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 31 14:49:13.787189 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.787171 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 31 14:49:13.787266 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.787201 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 31 14:49:13.801565 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.801543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77f9449df4-bp57p"] Jul 31 14:49:13.837648 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.837612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-stats-auth\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.837648 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.837646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.837855 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.837708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.837855 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.837761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-default-certificate\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.837855 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.837794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgsvz\" (UniqueName: \"kubernetes.io/projected/52236573-b133-40e2-bc8d-43e689688398-kube-api-access-xgsvz\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939112 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.939073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939290 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.939142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-default-certificate\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939290 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.939159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgsvz\" (UniqueName: \"kubernetes.io/projected/52236573-b133-40e2-bc8d-43e689688398-kube-api-access-xgsvz\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939290 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.939202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-stats-auth\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939290 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:13.939250 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:14.439227049 +0000 UTC m=+83.810193892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:13.939483 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.939353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.939483 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:13.939455 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:49:13.939555 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:13.939517 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:14.439499964 +0000 UTC m=+83.810466775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : secret "router-metrics-certs-default" not found Jul 31 14:49:13.941536 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.941509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-default-certificate\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.941627 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.941560 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-stats-auth\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:13.981754 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:13.981722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgsvz\" (UniqueName: \"kubernetes.io/projected/52236573-b133-40e2-bc8d-43e689688398-kube-api-access-xgsvz\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:14.251302 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:14.251209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:14.377647 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:14.377614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:14.443094 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:14.443060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:14.443242 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:14.443105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:14.443242 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:14.443200 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:49:14.443328 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:14.443249 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:15.443234468 +0000 UTC m=+84.814201278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:14.443328 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:14.443264 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:15.443257508 +0000 UTC m=+84.814224316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : secret "router-metrics-certs-default" not found Jul 31 14:49:15.451015 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:15.450978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:15.451354 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:15.451052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:15.451354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:15.451122 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:49:15.451354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:15.451187 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:17.451171654 +0000 UTC m=+86.822138477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : secret "router-metrics-certs-default" not found Jul 31 14:49:15.451354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:15.451200 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:17.451194568 +0000 UTC m=+86.822161376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:17.466728 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:17.466689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:17.467144 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:17.466739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:17.467144 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:17.466853 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:49:17.467144 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:17.466875 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:21.46685977 +0000 UTC m=+90.837826581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:17.467144 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:17.466907 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:21.466893238 +0000 UTC m=+90.837860046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : secret "router-metrics-certs-default" not found Jul 31 14:49:18.669286 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:18.669250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:18.805056 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:18.805022 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:18.899279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:18.899246 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.311400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:19.311366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.390547 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:19.390519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:19.958994 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:19.958966 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:20.028640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.028604 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qrnb5"] Jul 31 14:49:20.030487 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.030456 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:20.031967 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.031949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.038555 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.038535 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 14:49:20.038656 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.038553 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 14:49:20.038656 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.038535 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 14:49:20.038656 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.038544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j66bv\"" Jul 31 14:49:20.038932 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.038918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 14:49:20.048696 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.048677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrnb5"] Jul 31 14:49:20.087293 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.087259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad99efb-c8b1-422b-ac5e-c13d5490008c-data-volume\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.087454 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.087333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.087454 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.087366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad99efb-c8b1-422b-ac5e-c13d5490008c-crio-socket\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.087454 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.087429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrh95\" (UniqueName: \"kubernetes.io/projected/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-api-access-qrh95\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.087563 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.087505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188557 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad99efb-c8b1-422b-ac5e-c13d5490008c-data-volume\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad99efb-c8b1-422b-ac5e-c13d5490008c-crio-socket\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrh95\" (UniqueName: \"kubernetes.io/projected/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-api-access-qrh95\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.188738 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.188769 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.188820 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:20.688801488 +0000 UTC m=+90.059768300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : configmap "kube-rbac-proxy" not found Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.188838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:20.68882974 +0000 UTC m=+90.059796549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : secret "insights-runtime-extractor-tls" not found Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad99efb-c8b1-422b-ac5e-c13d5490008c-crio-socket\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.188958 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.188893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad99efb-c8b1-422b-ac5e-c13d5490008c-data-volume\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.226731 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.226671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrh95\" (UniqueName: \"kubernetes.io/projected/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-api-access-qrh95\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.691880 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.691837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.692080 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:20.691899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:20.692080 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.691986 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:49:20.692080 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.691994 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:49:20.692080 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.692038 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:21.692024825 +0000 UTC m=+91.062991635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : configmap "kube-rbac-proxy" not found Jul 31 14:49:20.692080 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:20.692051 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:21.692045232 +0000 UTC m=+91.063012042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : secret "insights-runtime-extractor-tls" not found Jul 31 14:49:21.034572 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.034540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:21.133102 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.133066 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:21.500126 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.500035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:21.500294 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.500222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:21.500294 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.500257 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:29.500234599 +0000 UTC m=+98.871201408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:21.500409 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.500302 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:49:21.500409 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.500407 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:29.500395984 +0000 UTC m=+98.871362793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : secret "router-metrics-certs-default" not found Jul 31 14:49:21.702648 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.702595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:21.702853 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:21.702677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:21.702853 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.702739 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:49:21.702853 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.702808 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:49:21.702853 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.702822 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:23.702807081 +0000 UTC m=+93.073773893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : secret "insights-runtime-extractor-tls" not found Jul 31 14:49:21.702853 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:21.702856 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:23.702843888 +0000 UTC m=+93.073810696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : configmap "kube-rbac-proxy" not found Jul 31 14:49:22.146648 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:22.146608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:22.673309 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:22.673280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vxq87_50eefe5b-80d0-4590-be39-a7f07ed822d8/dns-node-resolver/0.log" Jul 31 14:49:23.718213 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:23.718159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:23.718213 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:23.718227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:23.718635 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:23.718289 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:49:23.718635 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:23.718308 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:49:23.718635 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:23.718341 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:27.718327688 +0000 UTC m=+97.089294496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : configmap "kube-rbac-proxy" not found Jul 31 14:49:23.718635 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:23.718359 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:27.718347666 +0000 UTC m=+97.089314478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : secret "insights-runtime-extractor-tls" not found Jul 31 14:49:23.882744 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:23.882720 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v8j88_a079510b-d28d-4970-b93c-3460728b05d4/node-ca/0.log" Jul 31 14:49:23.977397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:23.977320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.130387 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.130356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.232980 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.232870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.417426 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.417396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.546486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.546443 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.625613 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.625574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:24.672589 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.672560 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zjt7z_52bcc543-a23c-4a00-be94-d971978c57c4/serve-healthcheck-canary/0.log" Jul 31 14:49:24.725510 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:24.725475 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.675009 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:25.674973 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:25.882874 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:25.882825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:26.264937 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:26.264901 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:26.464731 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:26.464700 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:26.898134 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:26.898101 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.463409 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.463370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.664641 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.664607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.749793 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.749696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:27.749914 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:27.749842 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:49:27.749914 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.749850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:27.749993 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:27.749917 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:35.749900146 +0000 UTC m=+105.120866959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : configmap "kube-rbac-proxy" not found Jul 31 14:49:27.749993 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:27.749990 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:49:27.750122 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:27.750034 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls podName:cad99efb-c8b1-422b-ac5e-c13d5490008c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:35.750021459 +0000 UTC m=+105.120988271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrnb5" (UID: "cad99efb-c8b1-422b-ac5e-c13d5490008c") : secret "insights-runtime-extractor-tls" not found Jul 31 14:49:27.862207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.862168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:27.962836 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:27.962790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:28.160079 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:28.160045 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:28.261069 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:28.261027 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:28.670073 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:28.670041 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:28.733654 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:28.733620 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:28.869691 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:28.869657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:29.275547 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.275515 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:29.464024 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.463991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:49:29.464140 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.464041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:49:29.466338 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.466308 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"image-registry-7df6577bf7-qn2tz\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:49:29.466629 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.466614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea7d0a8d-c93a-4423-8cbd-87b1ba866241-metrics-tls\") pod \"dns-default-r6hsm\" (UID: \"ea7d0a8d-c93a-4423-8cbd-87b1ba866241\") " pod="openshift-dns/dns-default-r6hsm" Jul 31 14:49:29.564799 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.564695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:29.564928 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.564880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:29.564982 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:29.564971 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle podName:52236573-b133-40e2-bc8d-43e689688398 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:45.564956385 +0000 UTC m=+114.935923195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle") pod "router-default-77f9449df4-bp57p" (UID: "52236573-b133-40e2-bc8d-43e689688398") : configmap references non-existent config key: service-ca.crt Jul 31 14:49:29.567088 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.567072 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52236573-b133-40e2-bc8d-43e689688398-metrics-certs\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:29.740191 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.740161 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8rc5\"" Jul 31 14:49:29.747983 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.747962 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:49:29.757436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.757418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-plcv4\"" Jul 31 14:49:29.766203 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.766183 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6hsm" Jul 31 14:49:29.888291 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.888261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:49:29.891202 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:29.891170 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd346173c_2381_4318_8a3d_7bd134b81b69.slice/crio-df32ff2455952c14b9a3f66c5cadadef5ca87fc9cbd3b2d1ac6b9bf217e862b9 WatchSource:0}: Error finding container df32ff2455952c14b9a3f66c5cadadef5ca87fc9cbd3b2d1ac6b9bf217e862b9: Status 404 returned error can't find the container with id df32ff2455952c14b9a3f66c5cadadef5ca87fc9cbd3b2d1ac6b9bf217e862b9 Jul 31 14:49:29.899630 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:29.899609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6hsm"] Jul 31 14:49:29.904238 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:29.904212 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7d0a8d_c93a_4423_8cbd_87b1ba866241.slice/crio-b98c7d9dba67a076d775dc8377416825d9efa9927f0f2d0faf4e5d88d39b91e2 WatchSource:0}: Error finding container b98c7d9dba67a076d775dc8377416825d9efa9927f0f2d0faf4e5d88d39b91e2: Status 404 returned error can't find the container with id b98c7d9dba67a076d775dc8377416825d9efa9927f0f2d0faf4e5d88d39b91e2 Jul 31 14:49:30.095907 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.095818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:30.292340 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.292295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:30.391886 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.391799 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:30.507661 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.507621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" event={"ID":"d346173c-2381-4318-8a3d-7bd134b81b69","Type":"ContainerStarted","Data":"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9"} Jul 31 14:49:30.507889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.507682 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" event={"ID":"d346173c-2381-4318-8a3d-7bd134b81b69","Type":"ContainerStarted","Data":"df32ff2455952c14b9a3f66c5cadadef5ca87fc9cbd3b2d1ac6b9bf217e862b9"} Jul 31 14:49:30.507889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.507865 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:49:30.508839 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.508813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6hsm" event={"ID":"ea7d0a8d-c93a-4423-8cbd-87b1ba866241","Type":"ContainerStarted","Data":"b98c7d9dba67a076d775dc8377416825d9efa9927f0f2d0faf4e5d88d39b91e2"} Jul 31 14:49:30.535128 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.535072 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" podStartSLOduration=99.53505326 podStartE2EDuration="1m39.53505326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:30.534556057 +0000 UTC m=+99.905522890" watchObservedRunningTime="2026-07-31 14:49:30.53505326 +0000 UTC m=+99.906020093" Jul 31 14:49:30.669488 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.669407 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:30.871013 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:30.870977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:31.478516 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:31.478483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:31.514921 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:31.514884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6hsm" event={"ID":"ea7d0a8d-c93a-4423-8cbd-87b1ba866241","Type":"ContainerStarted","Data":"7e9e1f1c2ebefb6797ecd05258cd2038f952cb132f0bf1149e0c9ba1d8db1fb4"} Jul 31 14:49:31.515069 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:31.514967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6hsm" event={"ID":"ea7d0a8d-c93a-4423-8cbd-87b1ba866241","Type":"ContainerStarted","Data":"e3bec17e034bae41007412c2c254518215068ed8481afd7179bbf8d8ae9d8bfd"} Jul 31 14:49:31.535052 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:31.534968 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r6hsm" podStartSLOduration=65.17118814 podStartE2EDuration="1m6.534954081s" totalImagesPullingTime="1.363765941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:31.533751125 +0000 UTC m=+100.904717956" watchObservedRunningTime="2026-07-31 14:49:31.534954081 +0000 UTC m=+100.905920911" Jul 31 14:49:31.754136 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:31.754086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:32.079817 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.079760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:32.178001 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.177964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:32.278194 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.278152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:32.466119 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.465988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:32.517601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.517573 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r6hsm" Jul 31 14:49:32.671263 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:32.671226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:33.267391 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:33.267355 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:33.445582 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:33.445547 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgnw9" Jul 31 14:49:33.664970 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:33.664887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:33.869185 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:33.869152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:34.464426 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:34.464396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:34.662558 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:34.662526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:35.813408 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:35.813363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:35.813893 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:35.813449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:35.814056 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:35.814033 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad99efb-c8b1-422b-ac5e-c13d5490008c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:35.815699 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:35.815680 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad99efb-c8b1-422b-ac5e-c13d5490008c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrnb5\" (UID: \"cad99efb-c8b1-422b-ac5e-c13d5490008c\") " pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:35.941190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:35.941140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrnb5" Jul 31 14:49:36.068537 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.068465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrnb5"] Jul 31 14:49:36.073427 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:36.073398 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad99efb_c8b1_422b_ac5e_c13d5490008c.slice/crio-2ed2b4c7af5a478e86e1915b9a7423c64557f87605e0af9af50362b6871cd760 WatchSource:0}: Error finding container 2ed2b4c7af5a478e86e1915b9a7423c64557f87605e0af9af50362b6871cd760: Status 404 returned error can't find the container with id 2ed2b4c7af5a478e86e1915b9a7423c64557f87605e0af9af50362b6871cd760 Jul 31 14:49:36.531595 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.531559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrnb5" event={"ID":"cad99efb-c8b1-422b-ac5e-c13d5490008c","Type":"ContainerStarted","Data":"f1e051fcca7c0c51412f8086e2e3785616313d06d3d5e72e208be871d802032b"} Jul 31 14:49:36.531765 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.531633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrnb5" event={"ID":"cad99efb-c8b1-422b-ac5e-c13d5490008c","Type":"ContainerStarted","Data":"2ed2b4c7af5a478e86e1915b9a7423c64557f87605e0af9af50362b6871cd760"} Jul 31 14:49:36.799702 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.799617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:36.900226 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.900193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:36.962167 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:36.962137 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:37.094621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.094531 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:37.473834 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.473735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:37.536977 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.536937 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrnb5" event={"ID":"cad99efb-c8b1-422b-ac5e-c13d5490008c","Type":"ContainerStarted","Data":"31e1267fc86182a7b188c611e4da44c215f27aa05099dce3557c82d59ebc3333"} Jul 31 14:49:37.711624 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.711577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:37.778619 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.778589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:37.893025 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:37.892989 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.178758 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.178714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.280503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.280469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.543969 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.543929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrnb5" event={"ID":"cad99efb-c8b1-422b-ac5e-c13d5490008c","Type":"ContainerStarted","Data":"c5125731bf55dc9514335eb374c147681bdb1fd0cb6d46f75f6626712310d0db"} Jul 31 14:49:38.549924 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.549898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.568559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.568513 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qrnb5" podStartSLOduration=17.625188295 podStartE2EDuration="19.568498601s" totalImagesPullingTime="1.943310306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:49:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:38.566972951 +0000 UTC m=+107.937939783" watchObservedRunningTime="2026-07-31 14:49:38.568498601 +0000 UTC m=+107.939465432" Jul 31 14:49:38.710283 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.710252 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:38.804434 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:38.804352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:39.317641 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:39.317609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:39.379730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:39.379703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:42.522609 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:42.522575 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r6hsm" Jul 31 14:49:43.869716 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.869687 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj"] Jul 31 14:49:43.872655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.872639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:43.878190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.878162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 31 14:49:43.878651 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.878485 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 31 14:49:43.879559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.879435 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 31 14:49:43.879559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.879482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 31 14:49:43.891890 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.891867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj"] Jul 31 14:49:43.982696 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.982659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-tmp\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:43.982882 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.982730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:43.982882 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:43.982817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v58t\" (UniqueName: \"kubernetes.io/projected/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-kube-api-access-8v58t\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.083661 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.083625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v58t\" (UniqueName: \"kubernetes.io/projected/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-kube-api-access-8v58t\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.083661 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.083664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-tmp\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.083894 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.083850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.084023 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.083994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-tmp\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.086257 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.086233 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.097308 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.097285 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v58t\" (UniqueName: \"kubernetes.io/projected/aa8391bc-c208-45c1-b8ca-baa8dcd91fe9-kube-api-access-8v58t\") pod \"klusterlet-addon-workmgr-7c9d94b897-sxbsj\" (UID: \"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.108729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.108702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:44.183838 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.183742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:44.192200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.192172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:44.307457 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.307425 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:44.323825 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.323801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj"] Jul 31 14:49:44.326742 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:44.326718 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8391bc_c208_45c1_b8ca_baa8dcd91fe9.slice/crio-07b6e715828587ca809c5d54a0028ffb166b457e021da5d60dc3753bf97cce60 WatchSource:0}: Error finding container 07b6e715828587ca809c5d54a0028ffb166b457e021da5d60dc3753bf97cce60: Status 404 returned error can't find the container with id 07b6e715828587ca809c5d54a0028ffb166b457e021da5d60dc3753bf97cce60 Jul 31 14:49:44.398396 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.398349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:44.563268 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:44.563239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" event={"ID":"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9","Type":"ContainerStarted","Data":"07b6e715828587ca809c5d54a0028ffb166b457e021da5d60dc3753bf97cce60"} Jul 31 14:49:45.595449 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:45.595408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:45.596252 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:45.596214 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52236573-b133-40e2-bc8d-43e689688398-service-ca-bundle\") pod \"router-default-77f9449df4-bp57p\" (UID: \"52236573-b133-40e2-bc8d-43e689688398\") " pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:45.892439 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:45.892350 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:46.049117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.049085 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77f9449df4-bp57p"] Jul 31 14:49:46.053274 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:46.053240 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52236573_b133_40e2_bc8d_43e689688398.slice/crio-6c8fe8726f54e75d58e89fb33c3af81457c7f65cad143ac396461a9256a712e6 WatchSource:0}: Error finding container 6c8fe8726f54e75d58e89fb33c3af81457c7f65cad143ac396461a9256a712e6: Status 404 returned error can't find the container with id 6c8fe8726f54e75d58e89fb33c3af81457c7f65cad143ac396461a9256a712e6 Jul 31 14:49:46.575495 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.575453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77f9449df4-bp57p" event={"ID":"52236573-b133-40e2-bc8d-43e689688398","Type":"ContainerStarted","Data":"16091b4a8c27909538b7ef8d0a62f5534c999ae7c9d5c5a022787260976a79fc"} Jul 31 14:49:46.575687 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.575519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77f9449df4-bp57p" event={"ID":"52236573-b133-40e2-bc8d-43e689688398","Type":"ContainerStarted","Data":"6c8fe8726f54e75d58e89fb33c3af81457c7f65cad143ac396461a9256a712e6"} Jul 31 14:49:46.598281 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.598177 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-77f9449df4-bp57p" podStartSLOduration=33.598158188 podStartE2EDuration="33.598158188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:46.597102091 +0000 UTC m=+115.968068919" watchObservedRunningTime="2026-07-31 14:49:46.598158188 +0000 UTC m=+115.969125018" Jul 31 14:49:46.747548 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.747491 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:46.850455 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.850374 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:46.893474 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.893441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:46.896736 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:46.896710 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:47.579514 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:47.579449 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:47.580852 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:47.580827 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-77f9449df4-bp57p" Jul 31 14:49:48.584085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:48.584051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" event={"ID":"aa8391bc-c208-45c1-b8ca-baa8dcd91fe9","Type":"ContainerStarted","Data":"293211531d12362ebdb30af49c5c1a7a6532ffabb9e10f4171abc928be53cabc"} Jul 31 14:49:48.584593 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:48.584107 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:48.585886 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:48.585862 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" Jul 31 14:49:48.601103 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:48.601017 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c9d94b897-sxbsj" podStartSLOduration=1.746360796 podStartE2EDuration="5.6009957s" totalImagesPullingTime="3.854634904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:48.600479391 +0000 UTC m=+117.971446222" watchObservedRunningTime="2026-07-31 14:49:48.6009957 +0000 UTC m=+117.971962532" Jul 31 14:49:48.707209 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:48.707175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:49.752830 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:49.752790 2564 patch_prober.go:28] interesting pod/image-registry-7df6577bf7-qn2tz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 14:49:49.753264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:49.752849 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 14:49:50.214099 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.214063 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:50.384544 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.384513 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v"] Jul 31 14:49:50.387419 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.387402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:50.389597 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.389576 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 14:49:50.389883 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.389866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p9c25\"" Jul 31 14:49:50.400255 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.400227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v"] Jul 31 14:49:50.537646 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.537618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4j6v\" (UID: \"ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:50.578501 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.578467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:50.638519 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.638488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4j6v\" (UID: \"ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:50.641092 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.641060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-k4j6v\" (UID: \"ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:50.650128 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.650096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:50.695978 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.695949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:50.850299 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:50.850200 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v"] Jul 31 14:49:50.855293 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:50.855263 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6b3c2c_c6e6_4ac9_9e9f_7b145b449151.slice/crio-4336e8b4713f260a5bc1da75f6b247ec573efb7f5d72aadf086cc595e8d7929a WatchSource:0}: Error finding container 4336e8b4713f260a5bc1da75f6b247ec573efb7f5d72aadf086cc595e8d7929a: Status 404 returned error can't find the container with id 4336e8b4713f260a5bc1da75f6b247ec573efb7f5d72aadf086cc595e8d7929a Jul 31 14:49:51.521552 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:51.521517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:49:51.596289 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:51.596258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" event={"ID":"ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151","Type":"ContainerStarted","Data":"4336e8b4713f260a5bc1da75f6b247ec573efb7f5d72aadf086cc595e8d7929a"} Jul 31 14:49:51.708874 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:51.708838 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:51.810381 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:51.810352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:52.478193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.478160 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:49:52.481211 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.481195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.483952 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.483923 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 31 14:49:52.484517 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7hgtc\"" Jul 31 14:49:52.484609 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484537 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 31 14:49:52.484678 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 31 14:49:52.484678 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 31 14:49:52.484678 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 31 14:49:52.484852 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484747 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 31 14:49:52.484913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.484901 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 31 14:49:52.492715 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.492695 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:49:52.554922 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.554885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.554922 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.554920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.555141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.554993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.555141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.555022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.555141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.555076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.555141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.555100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8wh\" (UniqueName: \"kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.604003 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.603967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" event={"ID":"ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151","Type":"ContainerStarted","Data":"458c6ae4658eceafe173e5335f601cea8bb091b738b3c385c05a7be0d27a4390"} Jul 31 14:49:52.604215 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.604192 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:52.609139 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.609121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" Jul 31 14:49:52.621422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.621377 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-k4j6v" podStartSLOduration=1.72999021 podStartE2EDuration="2.621358487s" totalImagesPullingTime="891.368277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:52.620855722 +0000 UTC m=+121.991822554" watchObservedRunningTime="2026-07-31 14:49:52.621358487 +0000 UTC m=+121.992325318" Jul 31 14:49:52.656102 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.656102 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.656324 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.656324 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8wh\" (UniqueName: \"kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.656324 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.656324 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.656227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.657051 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.657020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.657194 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.657020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.657384 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.657364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.658610 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.658590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.659070 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.659049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.665762 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.665727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8wh\" (UniqueName: \"kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh\") pod \"console-6495f758c4-7f2s7\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.790648 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.790616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:49:52.912201 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:52.912171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:49:52.916154 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:52.916123 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefb083c_75bc_40a6_8680_e6f19e1bddab.slice/crio-50b8db75b97f0364a78062323ff390ca4cce91e3f7248bcc45df3a5050a1c9c3 WatchSource:0}: Error finding container 50b8db75b97f0364a78062323ff390ca4cce91e3f7248bcc45df3a5050a1c9c3: Status 404 returned error can't find the container with id 50b8db75b97f0364a78062323ff390ca4cce91e3f7248bcc45df3a5050a1c9c3 Jul 31 14:49:53.094904 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.094803 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:53.401649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.401565 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:53.442418 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.442384 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-tfr9r"] Jul 31 14:49:53.445593 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.445569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.448402 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 14:49:53.448525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 31 14:49:53.448710 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448681 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 14:49:53.448832 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448740 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 31 14:49:53.448832 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448751 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 14:49:53.448832 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.448749 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jnc7f\"" Jul 31 14:49:53.456291 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.456082 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-tfr9r"] Jul 31 14:49:53.460954 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.460931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.461073 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.460963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.461073 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.460994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3243405-b6cf-4c3d-b990-51900be6cdd3-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.461073 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.461032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzc7w\" (UniqueName: \"kubernetes.io/projected/d3243405-b6cf-4c3d-b990-51900be6cdd3-kube-api-access-tzc7w\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.475882 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.475848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:53.562027 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.561994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.562534 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.562035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.562534 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.562058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3243405-b6cf-4c3d-b990-51900be6cdd3-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.562534 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.562084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzc7w\" (UniqueName: \"kubernetes.io/projected/d3243405-b6cf-4c3d-b990-51900be6cdd3-kube-api-access-tzc7w\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.562534 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:53.562151 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 31 14:49:53.562534 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:49:53.562221 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls podName:d3243405-b6cf-4c3d-b990-51900be6cdd3 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:54.06219909 +0000 UTC m=+123.433165915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-tfr9r" (UID: "d3243405-b6cf-4c3d-b990-51900be6cdd3") : secret "prometheus-operator-tls" not found Jul 31 14:49:53.562929 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.562904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3243405-b6cf-4c3d-b990-51900be6cdd3-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.564926 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.564901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.572673 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.572649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzc7w\" (UniqueName: \"kubernetes.io/projected/d3243405-b6cf-4c3d-b990-51900be6cdd3-kube-api-access-tzc7w\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:53.608989 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.608954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495f758c4-7f2s7" event={"ID":"fefb083c-75bc-40a6-8680-e6f19e1bddab","Type":"ContainerStarted","Data":"50b8db75b97f0364a78062323ff390ca4cce91e3f7248bcc45df3a5050a1c9c3"} Jul 31 14:49:53.684402 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:53.684309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:54.065636 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:54.065601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:54.068502 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:54.068475 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3243405-b6cf-4c3d-b990-51900be6cdd3-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-tfr9r\" (UID: \"d3243405-b6cf-4c3d-b990-51900be6cdd3\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:54.358144 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:54.358058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" Jul 31 14:49:54.500089 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:54.500024 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-tfr9r"] Jul 31 14:49:54.918665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:54.918627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:55.040546 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:55.040497 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:55.510250 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:55.510215 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3243405_b6cf_4c3d_b990_51900be6cdd3.slice/crio-1fbaa59e8d5465b8dc1ae6d3227b0563f94f29ad063366282d6973b94c1cf0cf WatchSource:0}: Error finding container 1fbaa59e8d5465b8dc1ae6d3227b0563f94f29ad063366282d6973b94c1cf0cf: Status 404 returned error can't find the container with id 1fbaa59e8d5465b8dc1ae6d3227b0563f94f29ad063366282d6973b94c1cf0cf Jul 31 14:49:55.616953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:55.616922 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495f758c4-7f2s7" event={"ID":"fefb083c-75bc-40a6-8680-e6f19e1bddab","Type":"ContainerStarted","Data":"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90"} Jul 31 14:49:55.617906 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:55.617884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" event={"ID":"d3243405-b6cf-4c3d-b990-51900be6cdd3","Type":"ContainerStarted","Data":"1fbaa59e8d5465b8dc1ae6d3227b0563f94f29ad063366282d6973b94c1cf0cf"} Jul 31 14:49:55.708237 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:55.708197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:55.770892 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:55.770808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:56.942146 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:56.942057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:57.122122 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.122089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:57.222360 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.222276 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:57.510397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.510337 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6495f758c4-7f2s7" podStartSLOduration=2.869373867 podStartE2EDuration="5.510316061s" totalImagesPullingTime="2.640942194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:56.643525706 +0000 UTC m=+126.014492837" watchObservedRunningTime="2026-07-31 14:49:57.510316061 +0000 UTC m=+126.881282895" Jul 31 14:49:57.511284 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.511264 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:49:57.514242 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.514227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.522361 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.522337 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 31 14:49:57.523539 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.523519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:49:57.593806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.593806 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.594041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.594041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.594041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbq4\" (UniqueName: \"kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.594041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.593971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.594041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.594012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.626555 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.626524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" event={"ID":"d3243405-b6cf-4c3d-b990-51900be6cdd3","Type":"ContainerStarted","Data":"a51380efe5f9c21476c1dcf2745ee15ba51a80c52fcd47ed9db6466d11212861"} Jul 31 14:49:57.626706 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.626580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" event={"ID":"d3243405-b6cf-4c3d-b990-51900be6cdd3","Type":"ContainerStarted","Data":"2ac5025528e438be43d49cd56431c4170f0346433a23ac8ebaef383baed0fe72"} Jul 31 14:49:57.644062 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.644018 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-tfr9r" podStartSLOduration=3.554296855 podStartE2EDuration="4.644004469s" totalImagesPullingTime="1.089707614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:57.643589861 +0000 UTC m=+127.014556692" watchObservedRunningTime="2026-07-31 14:49:57.644004469 +0000 UTC m=+127.014971299" Jul 31 14:49:57.694992 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.694954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.694992 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.694995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.695254 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.695386 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.695386 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbq4\" (UniqueName: \"kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.695493 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.695493 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.696064 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.696064 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695911 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.696064 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.695934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.696266 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.696201 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.698157 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.698140 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.698247 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.698230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.705100 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.705082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbq4\" (UniqueName: \"kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4\") pod \"console-664d8485d8-vlrlx\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.823369 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.823265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:49:57.950715 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:57.950684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:49:57.953476 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:49:57.953449 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3503ff8c_054b_4d47_9893_46902caaa02a.slice/crio-fe53f14d34db03bdc2a51273087c03548f062d436e73f17d3547289dc4b55c80 WatchSource:0}: Error finding container fe53f14d34db03bdc2a51273087c03548f062d436e73f17d3547289dc4b55c80: Status 404 returned error can't find the container with id fe53f14d34db03bdc2a51273087c03548f062d436e73f17d3547289dc4b55c80 Jul 31 14:49:58.632010 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:58.631974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8485d8-vlrlx" event={"ID":"3503ff8c-054b-4d47-9893-46902caaa02a","Type":"ContainerStarted","Data":"39bb8115df2a0829857b8797133b0e3790b7a14586de06ed7f7deea7a20c4da7"} Jul 31 14:49:58.632199 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:58.632032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8485d8-vlrlx" event={"ID":"3503ff8c-054b-4d47-9893-46902caaa02a","Type":"ContainerStarted","Data":"fe53f14d34db03bdc2a51273087c03548f062d436e73f17d3547289dc4b55c80"} Jul 31 14:49:58.653432 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:58.653373 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664d8485d8-vlrlx" podStartSLOduration=1.653354739 podStartE2EDuration="1.653354739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:58.652703138 +0000 UTC m=+128.023669994" watchObservedRunningTime="2026-07-31 14:49:58.653354739 +0000 UTC m=+128.024321571" Jul 31 14:49:59.552862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.552825 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:59.800532 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.800499 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:59.877765 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.877685 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh"] Jul 31 14:49:59.881017 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.880999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:49:59.884559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.884541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 31 14:49:59.884649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.884556 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bh2wf\"" Jul 31 14:49:59.884649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.884557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 31 14:49:59.898053 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.898024 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh"] Jul 31 14:49:59.912410 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.912380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgc9\" (UniqueName: \"kubernetes.io/projected/055a1e69-4903-4f49-8719-0fd89e1ff53b-kube-api-access-mkgc9\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:49:59.912568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.912424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:49:59.912568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.912451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:49:59.912568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.912477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055a1e69-4903-4f49-8719-0fd89e1ff53b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:49:59.914041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.914014 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:49:59.999074 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:49:59.999038 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxcb7"] Jul 31 14:50:00.002321 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.002298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.004795 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.004747 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 14:50:00.004952 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.004935 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 14:50:00.005165 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.005152 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 14:50:00.005835 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.005820 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lcpl5\"" Jul 31 14:50:00.013569 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-root\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013662 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgc9\" (UniqueName: \"kubernetes.io/projected/055a1e69-4903-4f49-8719-0fd89e1ff53b-kube-api-access-mkgc9\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.013662 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.013662 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055a1e69-4903-4f49-8719-0fd89e1ff53b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c33e9eba-4d7a-4558-85bb-22514b3ff670-kube-api-access-62tqw\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-wtmp\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-sys\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-metrics-client-ca\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.013849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.014166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.014166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.013894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-textfile\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.014403 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.014384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055a1e69-4903-4f49-8719-0fd89e1ff53b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.016069 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.016048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.016235 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.016216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/055a1e69-4903-4f49-8719-0fd89e1ff53b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.024709 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.024677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:00.028676 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.028655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgc9\" (UniqueName: \"kubernetes.io/projected/055a1e69-4903-4f49-8719-0fd89e1ff53b-kube-api-access-mkgc9\") pod \"openshift-state-metrics-6bb4d7b4dd-sfmsh\" (UID: \"055a1e69-4903-4f49-8719-0fd89e1ff53b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.115009 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.114969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-wtmp\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115009 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-sys\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-metrics-client-ca\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-sys\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-wtmp\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115253 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-textfile\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-root\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:50:00.115309 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c33e9eba-4d7a-4558-85bb-22514b3ff670-kube-api-access-62tqw\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:50:00.115373 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls podName:c33e9eba-4d7a-4558-85bb-22514b3ff670 nodeName:}" failed. No retries permitted until 2026-07-31 14:50:00.61535197 +0000 UTC m=+129.986318783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls") pod "node-exporter-bxcb7" (UID: "c33e9eba-4d7a-4558-85bb-22514b3ff670") : secret "node-exporter-tls" not found Jul 31 14:50:00.115517 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115382 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c33e9eba-4d7a-4558-85bb-22514b3ff670-root\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115734 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-textfile\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115734 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-metrics-client-ca\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.115852 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.115835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.117434 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.117418 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.124520 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.124495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tqw\" (UniqueName: \"kubernetes.io/projected/c33e9eba-4d7a-4558-85bb-22514b3ff670-kube-api-access-62tqw\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.189856 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.189742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" Jul 31 14:50:00.274979 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.274939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:00.359227 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.359197 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh"] Jul 31 14:50:00.362134 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:00.362108 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055a1e69_4903_4f49_8719_0fd89e1ff53b.slice/crio-57e8022acfa921b983353745ddecca44fd805d0b82185466fae444ffb07a8071 WatchSource:0}: Error finding container 57e8022acfa921b983353745ddecca44fd805d0b82185466fae444ffb07a8071: Status 404 returned error can't find the container with id 57e8022acfa921b983353745ddecca44fd805d0b82185466fae444ffb07a8071 Jul 31 14:50:00.399684 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.399652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:00.483794 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.483758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:00.586056 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.586009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:00.621364 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.621330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.623615 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.623588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c33e9eba-4d7a-4558-85bb-22514b3ff670-node-exporter-tls\") pod \"node-exporter-bxcb7\" (UID: \"c33e9eba-4d7a-4558-85bb-22514b3ff670\") " pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.640950 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.640920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" event={"ID":"055a1e69-4903-4f49-8719-0fd89e1ff53b","Type":"ContainerStarted","Data":"86aaf92a0c47bbcc6646f94397b4d18ad1dd2afffbe63c9d2454813131a40949"} Jul 31 14:50:00.641075 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.640973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" event={"ID":"055a1e69-4903-4f49-8719-0fd89e1ff53b","Type":"ContainerStarted","Data":"145b907c8ac8e9e358d7afd135251b3e818cf9cf840385e1675e1f51ea429a5f"} Jul 31 14:50:00.641075 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.640991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" event={"ID":"055a1e69-4903-4f49-8719-0fd89e1ff53b","Type":"ContainerStarted","Data":"57e8022acfa921b983353745ddecca44fd805d0b82185466fae444ffb07a8071"} Jul 31 14:50:00.911315 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.911275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxcb7" Jul 31 14:50:00.922461 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:00.922434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33e9eba_4d7a_4558_85bb_22514b3ff670.slice/crio-7a7e0f48c2583d9d6ec81e3dfd5d8e8e8c6e8b65478df4520deface4f991ad65 WatchSource:0}: Error finding container 7a7e0f48c2583d9d6ec81e3dfd5d8e8e8c6e8b65478df4520deface4f991ad65: Status 404 returned error can't find the container with id 7a7e0f48c2583d9d6ec81e3dfd5d8e8e8c6e8b65478df4520deface4f991ad65 Jul 31 14:50:00.961483 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:00.961412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:01.023935 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.023889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:50:01.028632 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.026865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70172f5d-eab0-4b97-8058-5361e0ea20c1-metrics-certs\") pod \"network-metrics-daemon-zt6tc\" (UID: \"70172f5d-eab0-4b97-8058-5361e0ea20c1\") " pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:50:01.071406 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.071368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:01.105912 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.105881 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:01.109394 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.109375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.113768 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.113737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:50:01.114283 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114257 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:50:01.114283 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:50:01.114590 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114572 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2l7gm\"" Jul 31 14:50:01.114703 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:50:01.114889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114868 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:50:01.114889 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.114881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:50:01.115132 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.115103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:50:01.115217 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.115201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:50:01.115285 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.115105 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:50:01.124319 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124411 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124411 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhrqz\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124497 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124497 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124564 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124564 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124564 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124692 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124726 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124726 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.124834 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.124725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.132225 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.132200 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:01.169996 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.169913 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:01.212634 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.212603 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrzg7\"" Jul 31 14:50:01.220542 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.220515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zt6tc" Jul 31 14:50:01.225883 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.225857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrqz\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.225976 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.225895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.225976 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.225917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226086 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226142 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226237 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226295 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226295 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226707 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226707 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226707 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.226916 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.226715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.230044 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.229388 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.230044 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.229835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.230213 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.230040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.230737 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.230706 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.230737 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.230718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.231452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.231430 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.234840 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.231722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.234840 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.233895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.234840 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.234728 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.235915 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.235887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.239284 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.239264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.240621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.240601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhrqz\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz\") pod \"alertmanager-main-0\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.419966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.419931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:50:01.590107 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.590077 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:50:01.594154 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:01.594126 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73393c0a_dfe7_484d_86fd_7423f13d4d82.slice/crio-9af009929edadc6026ed0ae83ef2eb993b4636e926e58cc5150ae2fa41ee7a09 WatchSource:0}: Error finding container 9af009929edadc6026ed0ae83ef2eb993b4636e926e58cc5150ae2fa41ee7a09: Status 404 returned error can't find the container with id 9af009929edadc6026ed0ae83ef2eb993b4636e926e58cc5150ae2fa41ee7a09 Jul 31 14:50:01.595752 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.595691 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zt6tc"] Jul 31 14:50:01.597869 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:01.597843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70172f5d_eab0_4b97_8058_5361e0ea20c1.slice/crio-2771c1ba98ce87c8fda2ba2f220ebaacadbd8108be919db2b924492e77a2ae2f WatchSource:0}: Error finding container 2771c1ba98ce87c8fda2ba2f220ebaacadbd8108be919db2b924492e77a2ae2f: Status 404 returned error can't find the container with id 2771c1ba98ce87c8fda2ba2f220ebaacadbd8108be919db2b924492e77a2ae2f Jul 31 14:50:01.646595 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.646556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" event={"ID":"055a1e69-4903-4f49-8719-0fd89e1ff53b","Type":"ContainerStarted","Data":"37d9e181c60a59ee51525c64ac53c14767a06a260f55735b37e99cfc5081a5e2"} Jul 31 14:50:01.647789 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.647752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"9af009929edadc6026ed0ae83ef2eb993b4636e926e58cc5150ae2fa41ee7a09"} Jul 31 14:50:01.648810 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.648784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt6tc" event={"ID":"70172f5d-eab0-4b97-8058-5361e0ea20c1","Type":"ContainerStarted","Data":"2771c1ba98ce87c8fda2ba2f220ebaacadbd8108be919db2b924492e77a2ae2f"} Jul 31 14:50:01.649842 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.649818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxcb7" event={"ID":"c33e9eba-4d7a-4558-85bb-22514b3ff670","Type":"ContainerStarted","Data":"7a7e0f48c2583d9d6ec81e3dfd5d8e8e8c6e8b65478df4520deface4f991ad65"} Jul 31 14:50:01.668451 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:01.668392 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-sfmsh" podStartSLOduration=1.677633509 podStartE2EDuration="2.668375329s" totalImagesPullingTime="990.74182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:01.667638453 +0000 UTC m=+131.038605285" watchObservedRunningTime="2026-07-31 14:50:01.668375329 +0000 UTC m=+131.039342159" Jul 31 14:50:02.119599 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.119530 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:02.221254 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.221223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:02.657050 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.657004 2564 generic.go:356] "Generic (PLEG): container finished" podID="c33e9eba-4d7a-4558-85bb-22514b3ff670" containerID="4db9d17202fd8fdf63ae7694a47eed5f8085676914b64b0fe6a4ea246b109e5b" exitCode=0 Jul 31 14:50:02.657559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.657061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxcb7" event={"ID":"c33e9eba-4d7a-4558-85bb-22514b3ff670","Type":"ContainerDied","Data":"4db9d17202fd8fdf63ae7694a47eed5f8085676914b64b0fe6a4ea246b109e5b"} Jul 31 14:50:02.791295 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.791224 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:02.791503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.791302 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:02.797988 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.797958 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:02.883639 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:02.883597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:03.000561 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.000363 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:03.062333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.062298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:03.662645 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.662605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxcb7" event={"ID":"c33e9eba-4d7a-4558-85bb-22514b3ff670","Type":"ContainerStarted","Data":"557cf84e3c59efad512491275c6da0e10bfe2ac86f53bce5432fa95795b85e16"} Jul 31 14:50:03.663063 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.662664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxcb7" event={"ID":"c33e9eba-4d7a-4558-85bb-22514b3ff670","Type":"ContainerStarted","Data":"b41b9812075af33041e5fc51ddd59bd7b1a42f887e9daf2a38f2e0f9df7b9103"} Jul 31 14:50:03.664155 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.664131 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a" exitCode=0 Jul 31 14:50:03.664283 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.664200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a"} Jul 31 14:50:03.665995 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.665973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt6tc" event={"ID":"70172f5d-eab0-4b97-8058-5361e0ea20c1","Type":"ContainerStarted","Data":"6ec3ab40dc1e0522e3014833a87ca9caa9b1f0cd93de3e10005f2ca1b20247bc"} Jul 31 14:50:03.666060 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.666017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zt6tc" event={"ID":"70172f5d-eab0-4b97-8058-5361e0ea20c1","Type":"ContainerStarted","Data":"e96de519726f3eee378bf6c4cef8c772363a55f8ccf65bb6278dfa313ccd373d"} Jul 31 14:50:03.669803 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.669763 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:03.688441 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.688395 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxcb7" podStartSLOduration=3.362383103 podStartE2EDuration="4.688382179s" totalImagesPullingTime="1.2595155s" totalInitContainerRuntime="66.483576ms" isStatefulPod=true podCreationTimestamp="2026-07-31 14:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:03.687133075 +0000 UTC m=+133.058099905" watchObservedRunningTime="2026-07-31 14:50:03.688382179 +0000 UTC m=+133.059349026" Jul 31 14:50:03.705657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.705611 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zt6tc" podStartSLOduration=131.226749975 podStartE2EDuration="2m12.705594803s" totalImagesPullingTime="1.478844828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:03.704323487 +0000 UTC m=+133.075290317" watchObservedRunningTime="2026-07-31 14:50:03.705594803 +0000 UTC m=+133.076561635" Jul 31 14:50:03.764214 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.764178 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:03.861433 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.861396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:03.960478 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:03.960395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:04.646371 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.646339 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:50:04.679542 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.679513 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:04.683766 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.683743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.694687 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.694658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:04.756290 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756290 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756586 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mlj\" (UniqueName: \"kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756969 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.756969 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.756915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mlj\" (UniqueName: \"kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.857913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.857835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.858567 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.858538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.858567 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.858558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.858567 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.858572 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.858971 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.858955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.860331 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.860305 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.860453 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.860412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.869055 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.869036 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mlj\" (UniqueName: \"kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj\") pod \"console-68d84595cb-s2mds\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:04.992390 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:04.992303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:05.132098 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.132074 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:05.134666 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:05.134631 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7acd90b_a4e5_4dee_a8f8_9ed77e5d6167.slice/crio-95d2880c6d70682bc967303df51c0a9151b4c68b892cf967d064699fce3ac194 WatchSource:0}: Error finding container 95d2880c6d70682bc967303df51c0a9151b4c68b892cf967d064699fce3ac194: Status 404 returned error can't find the container with id 95d2880c6d70682bc967303df51c0a9151b4c68b892cf967d064699fce3ac194 Jul 31 14:50:05.178656 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.178623 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8"] Jul 31 14:50:05.183321 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.183296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.187270 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 31 14:50:05.187270 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-92fm9\"" Jul 31 14:50:05.187270 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187090 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 31 14:50:05.187270 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187123 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 31 14:50:05.187962 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187941 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 31 14:50:05.188056 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.187945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 31 14:50:05.193059 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.193025 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 31 14:50:05.204337 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.204262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8"] Jul 31 14:50:05.262544 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262544 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5tjk\" (UniqueName: \"kubernetes.io/projected/deddcffe-3e59-4031-b7fe-a8b1c0156d03-kube-api-access-q5tjk\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-metrics-client-ca\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-federate-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262904 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.262904 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.262810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363361 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5tjk\" (UniqueName: \"kubernetes.io/projected/deddcffe-3e59-4031-b7fe-a8b1c0156d03-kube-api-access-q5tjk\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-metrics-client-ca\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-federate-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363525 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.363866 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.363598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.364307 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.364282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-metrics-client-ca\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.364430 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.364322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-serving-certs-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.364535 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.364507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.366212 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.366184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-federate-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.366212 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.366199 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.366387 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.366368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.366479 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.366463 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/deddcffe-3e59-4031-b7fe-a8b1c0156d03-telemeter-client-tls\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.371843 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.371826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5tjk\" (UniqueName: \"kubernetes.io/projected/deddcffe-3e59-4031-b7fe-a8b1c0156d03-kube-api-access-q5tjk\") pod \"telemeter-client-5ddd5db5f6-q4pf8\" (UID: \"deddcffe-3e59-4031-b7fe-a8b1c0156d03\") " pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.447924 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.447880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:05.508483 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.508451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" Jul 31 14:50:05.510594 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.510564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:05.659041 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.659007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8"] Jul 31 14:50:05.678320 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.678285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d84595cb-s2mds" event={"ID":"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167","Type":"ContainerStarted","Data":"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772"} Jul 31 14:50:05.678483 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.678345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d84595cb-s2mds" event={"ID":"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167","Type":"ContainerStarted","Data":"95d2880c6d70682bc967303df51c0a9151b4c68b892cf967d064699fce3ac194"} Jul 31 14:50:05.703957 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:05.699742 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68d84595cb-s2mds" podStartSLOduration=1.699721834 podStartE2EDuration="1.699721834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:05.699453764 +0000 UTC m=+135.070420596" watchObservedRunningTime="2026-07-31 14:50:05.699721834 +0000 UTC m=+135.070688666" Jul 31 14:50:05.954188 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:05.954110 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeddcffe_3e59_4031_b7fe_a8b1c0156d03.slice/crio-f12a8d0e7457170a64ea450f4e6109dedd82fb418255d02c8b8c42cf0386801c WatchSource:0}: Error finding container f12a8d0e7457170a64ea450f4e6109dedd82fb418255d02c8b8c42cf0386801c: Status 404 returned error can't find the container with id f12a8d0e7457170a64ea450f4e6109dedd82fb418255d02c8b8c42cf0386801c Jul 31 14:50:06.236576 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.236539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:06.688494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.688455 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5"} Jul 31 14:50:06.688672 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.688589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7"} Jul 31 14:50:06.688672 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.688637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca"} Jul 31 14:50:06.688761 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.688678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264"} Jul 31 14:50:06.688761 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.688720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973"} Jul 31 14:50:06.689683 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:06.689652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" event={"ID":"deddcffe-3e59-4031-b7fe-a8b1c0156d03","Type":"ContainerStarted","Data":"f12a8d0e7457170a64ea450f4e6109dedd82fb418255d02c8b8c42cf0386801c"} Jul 31 14:50:07.535798 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:07.535701 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:50:07.650270 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:07.650214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:07.749927 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:07.749889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:07.823850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:07.823819 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:50:07.850452 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:07.850423 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:08.704633 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.704593 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" event={"ID":"deddcffe-3e59-4031-b7fe-a8b1c0156d03","Type":"ContainerStarted","Data":"4ad31421554003484b8094a0c777ec416abd0bcbb28fc5f84d4c89a17f1de41c"} Jul 31 14:50:08.705063 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.704697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" event={"ID":"deddcffe-3e59-4031-b7fe-a8b1c0156d03","Type":"ContainerStarted","Data":"b35346e66ee94e8919e10d0bddb32115b74bc0b5d580b3b8a344d23110ffc3f2"} Jul 31 14:50:08.705063 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.704731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" event={"ID":"deddcffe-3e59-4031-b7fe-a8b1c0156d03","Type":"ContainerStarted","Data":"1c9e12ba119f2c98a5e4f9b53d0e65bc195f9dd0bececb28cbe5d07674e51f23"} Jul 31 14:50:08.707986 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.707963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerStarted","Data":"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65"} Jul 31 14:50:08.731611 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.731555 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ddd5db5f6-q4pf8" podStartSLOduration=1.992629695 podStartE2EDuration="3.73154245s" totalImagesPullingTime="1.738912755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:08.731111097 +0000 UTC m=+138.102077930" watchObservedRunningTime="2026-07-31 14:50:08.73154245 +0000 UTC m=+138.102509279" Jul 31 14:50:08.762069 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.762020 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.209443478 podStartE2EDuration="7.76200685s" totalImagesPullingTime="5.536534233s" totalInitContainerRuntime="16.029139ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:08.760633096 +0000 UTC m=+138.131599940" watchObservedRunningTime="2026-07-31 14:50:08.76200685 +0000 UTC m=+138.132973727" Jul 31 14:50:08.841138 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.841106 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:08.892429 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.892391 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:50:08.895781 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.895752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.909895 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.909865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:50:08.997080 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.996989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997080 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997080 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9dg\" (UniqueName: \"kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:08.997333 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:08.997219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.033317 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.033285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:09.091819 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.091764 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:09.097903 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.097882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.097999 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.097914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.097999 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.097938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9dg\" (UniqueName: \"kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098104 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098154 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098209 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098260 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098945 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.098945 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098931 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.099085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.098910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.099249 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.099225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.100975 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.100952 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.101051 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.100957 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.108005 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.107976 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9dg\" (UniqueName: \"kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg\") pod \"console-7559448446-zsjjj\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.204983 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.204940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:09.354953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.354925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:50:09.357354 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:50:09.357325 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fe4b6b_8d78_466b_8c27_ce93bb84cbb1.slice/crio-838139ba6c3780127dd5ec5edfcdd29576b51fc3b8e7313a30b5de69236a3d06 WatchSource:0}: Error finding container 838139ba6c3780127dd5ec5edfcdd29576b51fc3b8e7313a30b5de69236a3d06: Status 404 returned error can't find the container with id 838139ba6c3780127dd5ec5edfcdd29576b51fc3b8e7313a30b5de69236a3d06 Jul 31 14:50:09.680995 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.680884 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:09.713596 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.713556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7559448446-zsjjj" event={"ID":"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1","Type":"ContainerStarted","Data":"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b"} Jul 31 14:50:09.714053 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.713609 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7559448446-zsjjj" event={"ID":"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1","Type":"ContainerStarted","Data":"838139ba6c3780127dd5ec5edfcdd29576b51fc3b8e7313a30b5de69236a3d06"} Jul 31 14:50:09.741314 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.741266 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7559448446-zsjjj" podStartSLOduration=1.741250313 podStartE2EDuration="1.741250313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:09.740908053 +0000 UTC m=+139.111874885" watchObservedRunningTime="2026-07-31 14:50:09.741250313 +0000 UTC m=+139.112217144" Jul 31 14:50:09.754224 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:09.754196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:12.188738 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:12.188694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:12.289843 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:12.289801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:14.993098 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:14.993049 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:17.166883 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:17.166843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:17.267166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:17.267136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:19.205838 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:19.205800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:19.206350 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:19.205857 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:19.211281 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:19.211255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:19.757716 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:19.757685 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:50:19.862202 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:19.862168 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:50:20.023177 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:20.023143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:20.123524 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:20.123478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:20.226370 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:20.226330 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:22.120214 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:22.120180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:22.220766 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:22.220731 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:22.281557 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:22.281516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:27.159561 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:27.159522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:27.217651 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:27.217615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:29.665427 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.665391 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-664d8485d8-vlrlx" podUID="3503ff8c-054b-4d47-9893-46902caaa02a" containerName="console" containerID="cri-o://39bb8115df2a0829857b8797133b0e3790b7a14586de06ed7f7deea7a20c4da7" gracePeriod=15 Jul 31 14:50:29.792858 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.792765 2564 generic.go:356] "Generic (PLEG): container finished" podID="3503ff8c-054b-4d47-9893-46902caaa02a" containerID="39bb8115df2a0829857b8797133b0e3790b7a14586de06ed7f7deea7a20c4da7" exitCode=0 Jul 31 14:50:29.792858 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.792847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8485d8-vlrlx" event={"ID":"3503ff8c-054b-4d47-9893-46902caaa02a","Type":"ContainerDied","Data":"39bb8115df2a0829857b8797133b0e3790b7a14586de06ed7f7deea7a20c4da7"} Jul 31 14:50:29.911919 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.911898 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:50:29.974943 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.974906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbq4\" (UniqueName: \"kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.974953 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.974973 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.974996 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975095 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975369 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975147 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle\") pod \"3503ff8c-054b-4d47-9893-46902caaa02a\" (UID: \"3503ff8c-054b-4d47-9893-46902caaa02a\") " Jul 31 14:50:29.975423 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975386 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:29.975423 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975395 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config" (OuterVolumeSpecName: "console-config") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:29.975522 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975426 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca" (OuterVolumeSpecName: "service-ca") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:29.975924 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.975890 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:29.977357 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.977331 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:29.977435 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.977382 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:29.977478 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:29.977442 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4" (OuterVolumeSpecName: "kube-api-access-knbq4") pod "3503ff8c-054b-4d47-9893-46902caaa02a" (UID: "3503ff8c-054b-4d47-9893-46902caaa02a"). InnerVolumeSpecName "kube-api-access-knbq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:30.076790 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076749 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-oauth-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076803 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-trusted-ca-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076813 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knbq4\" (UniqueName: \"kubernetes.io/projected/3503ff8c-054b-4d47-9893-46902caaa02a-kube-api-access-knbq4\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076822 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-oauth-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076831 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-console-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076839 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3503ff8c-054b-4d47-9893-46902caaa02a-service-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.076949 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.076847 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3503ff8c-054b-4d47-9893-46902caaa02a-console-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:30.798004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.797965 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d8485d8-vlrlx" event={"ID":"3503ff8c-054b-4d47-9893-46902caaa02a","Type":"ContainerDied","Data":"fe53f14d34db03bdc2a51273087c03548f062d436e73f17d3547289dc4b55c80"} Jul 31 14:50:30.798004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.797993 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d8485d8-vlrlx" Jul 31 14:50:30.798515 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.798068 2564 scope.go:117] "RemoveContainer" containerID="39bb8115df2a0829857b8797133b0e3790b7a14586de06ed7f7deea7a20c4da7" Jul 31 14:50:30.830593 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.830567 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:50:30.834637 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:30.834615 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664d8485d8-vlrlx"] Jul 31 14:50:31.103191 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:31.103113 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3503ff8c-054b-4d47-9893-46902caaa02a" path="/var/lib/kubelet/pods/3503ff8c-054b-4d47-9893-46902caaa02a/volumes" Jul 31 14:50:32.557559 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.557525 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" containerName="registry" containerID="cri-o://7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9" gracePeriod=30 Jul 31 14:50:32.805307 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.805283 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:50:32.806787 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.806750 2564 generic.go:356] "Generic (PLEG): container finished" podID="d346173c-2381-4318-8a3d-7bd134b81b69" containerID="7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9" exitCode=0 Jul 31 14:50:32.806923 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.806796 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" Jul 31 14:50:32.806923 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.806818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" event={"ID":"d346173c-2381-4318-8a3d-7bd134b81b69","Type":"ContainerDied","Data":"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9"} Jul 31 14:50:32.806923 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.806877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df6577bf7-qn2tz" event={"ID":"d346173c-2381-4318-8a3d-7bd134b81b69","Type":"ContainerDied","Data":"df32ff2455952c14b9a3f66c5cadadef5ca87fc9cbd3b2d1ac6b9bf217e862b9"} Jul 31 14:50:32.806923 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.806898 2564 scope.go:117] "RemoveContainer" containerID="7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9" Jul 31 14:50:32.815202 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.815187 2564 scope.go:117] "RemoveContainer" containerID="7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9" Jul 31 14:50:32.815450 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:50:32.815433 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9\": container with ID starting with 7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9 not found: ID does not exist" containerID="7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9" Jul 31 14:50:32.815494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.815457 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9"} err="failed to get container status \"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9\": rpc error: code = NotFound desc = could not find container \"7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9\": container with ID starting with 7fbcf87c60453a0366e21488b717d5b85aeb3bf5df69d12e017376b26b8ed1a9 not found: ID does not exist" Jul 31 14:50:32.902824 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902791 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902842 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902869 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902913 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902940 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902967 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903004 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.902997 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcts\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903287 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.903039 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") pod \"d346173c-2381-4318-8a3d-7bd134b81b69\" (UID: \"d346173c-2381-4318-8a3d-7bd134b81b69\") " Jul 31 14:50:32.903405 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.903353 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:32.903532 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.903413 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:32.905552 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.905527 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:32.905729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.905572 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:32.905729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.905571 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:32.905729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.905658 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:32.905921 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.905796 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts" (OuterVolumeSpecName: "kube-api-access-txcts") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "kube-api-access-txcts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:32.913651 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:32.913626 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d346173c-2381-4318-8a3d-7bd134b81b69" (UID: "d346173c-2381-4318-8a3d-7bd134b81b69"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:50:33.004436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004405 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-registry-tls\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004434 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d346173c-2381-4318-8a3d-7bd134b81b69-ca-trust-extracted\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004444 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-bound-sa-token\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004642 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004454 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-image-registry-private-configuration\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004642 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004463 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-trusted-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004642 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004472 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d346173c-2381-4318-8a3d-7bd134b81b69-registry-certificates\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004642 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004480 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d346173c-2381-4318-8a3d-7bd134b81b69-installation-pull-secrets\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.004642 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.004488 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcts\" (UniqueName: \"kubernetes.io/projected/d346173c-2381-4318-8a3d-7bd134b81b69-kube-api-access-txcts\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:33.128903 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.128872 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:50:33.135562 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.135540 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df6577bf7-qn2tz"] Jul 31 14:50:33.859981 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:33.859940 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68d84595cb-s2mds" podUID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" containerName="console" containerID="cri-o://c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772" gracePeriod=15 Jul 31 14:50:34.095894 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.095870 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:34.215247 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215247 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215219 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215247 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215245 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215451 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45mlj\" (UniqueName: \"kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215510 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215448 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215567 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215512 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215567 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215549 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert\") pod \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\" (UID: \"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167\") " Jul 31 14:50:34.215664 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215590 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca" (OuterVolumeSpecName: "service-ca") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:34.215844 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215825 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-service-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.215951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215896 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config" (OuterVolumeSpecName: "console-config") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:34.215951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215936 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:34.215951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.215942 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:34.217364 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.217342 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:34.217495 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.217479 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj" (OuterVolumeSpecName: "kube-api-access-45mlj") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "kube-api-access-45mlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:34.217538 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.217497 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" (UID: "a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:34.316580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316544 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45mlj\" (UniqueName: \"kubernetes.io/projected/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-kube-api-access-45mlj\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.316580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316573 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.316580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316585 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-trusted-ca-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.316833 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316597 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-oauth-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.316833 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316607 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.316833 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.316615 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167-console-oauth-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:34.816663 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.816626 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" containerID="c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772" exitCode=0 Jul 31 14:50:34.816862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.816670 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d84595cb-s2mds" Jul 31 14:50:34.816862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.816687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d84595cb-s2mds" event={"ID":"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167","Type":"ContainerDied","Data":"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772"} Jul 31 14:50:34.816862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.816730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d84595cb-s2mds" event={"ID":"a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167","Type":"ContainerDied","Data":"95d2880c6d70682bc967303df51c0a9151b4c68b892cf967d064699fce3ac194"} Jul 31 14:50:34.816862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.816750 2564 scope.go:117] "RemoveContainer" containerID="c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772" Jul 31 14:50:34.825233 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.825213 2564 scope.go:117] "RemoveContainer" containerID="c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772" Jul 31 14:50:34.825496 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:50:34.825472 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772\": container with ID starting with c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772 not found: ID does not exist" containerID="c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772" Jul 31 14:50:34.825568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.825506 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772"} err="failed to get container status \"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772\": rpc error: code = NotFound desc = could not find container \"c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772\": container with ID starting with c7f55437915c2315c527a29434cc24b7565ccc68e1b9a32dc384510fbe2cd772 not found: ID does not exist" Jul 31 14:50:34.841315 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.841286 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:34.845277 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:34.845254 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68d84595cb-s2mds"] Jul 31 14:50:35.102811 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:35.102715 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" path="/var/lib/kubelet/pods/a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167/volumes" Jul 31 14:50:35.103145 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:35.103127 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" path="/var/lib/kubelet/pods/d346173c-2381-4318-8a3d-7bd134b81b69/volumes" Jul 31 14:50:35.280758 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:35.280722 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:35.895447 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:35.895413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:36.617752 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:36.617719 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:36.858146 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:36.858093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:36.958876 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:36.958796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:42.163867 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:42.163832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:42.233044 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:42.232986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:50:44.880614 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:44.880510 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6495f758c4-7f2s7" podUID="fefb083c-75bc-40a6-8680-e6f19e1bddab" containerName="console" containerID="cri-o://aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90" gracePeriod=15 Jul 31 14:50:45.113982 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.113957 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:45.206663 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206575 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.206663 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206622 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.206663 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206651 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm8wh\" (UniqueName: \"kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.206951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206666 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.206951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.206951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206724 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca\") pod \"fefb083c-75bc-40a6-8680-e6f19e1bddab\" (UID: \"fefb083c-75bc-40a6-8680-e6f19e1bddab\") " Jul 31 14:50:45.207101 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.206995 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config" (OuterVolumeSpecName: "console-config") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:45.207174 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.207143 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:45.207236 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.207192 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca" (OuterVolumeSpecName: "service-ca") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:45.208962 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.208932 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh" (OuterVolumeSpecName: "kube-api-access-lm8wh") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "kube-api-access-lm8wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:45.208962 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.208934 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:45.209089 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.209031 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fefb083c-75bc-40a6-8680-e6f19e1bddab" (UID: "fefb083c-75bc-40a6-8680-e6f19e1bddab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:45.307207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307170 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.307207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307199 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.307207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307210 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm8wh\" (UniqueName: \"kubernetes.io/projected/fefb083c-75bc-40a6-8680-e6f19e1bddab-kube-api-access-lm8wh\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.307207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307218 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fefb083c-75bc-40a6-8680-e6f19e1bddab-console-oauth-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.307490 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307226 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-oauth-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.307490 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.307235 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fefb083c-75bc-40a6-8680-e6f19e1bddab-service-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:50:45.861335 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.861298 2564 generic.go:356] "Generic (PLEG): container finished" podID="fefb083c-75bc-40a6-8680-e6f19e1bddab" containerID="aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90" exitCode=0 Jul 31 14:50:45.861503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.861345 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495f758c4-7f2s7" Jul 31 14:50:45.861503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.861384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495f758c4-7f2s7" event={"ID":"fefb083c-75bc-40a6-8680-e6f19e1bddab","Type":"ContainerDied","Data":"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90"} Jul 31 14:50:45.861503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.861437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495f758c4-7f2s7" event={"ID":"fefb083c-75bc-40a6-8680-e6f19e1bddab","Type":"ContainerDied","Data":"50b8db75b97f0364a78062323ff390ca4cce91e3f7248bcc45df3a5050a1c9c3"} Jul 31 14:50:45.861503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.861457 2564 scope.go:117] "RemoveContainer" containerID="aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90" Jul 31 14:50:45.869657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.869640 2564 scope.go:117] "RemoveContainer" containerID="aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90" Jul 31 14:50:45.869939 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:50:45.869920 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90\": container with ID starting with aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90 not found: ID does not exist" containerID="aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90" Jul 31 14:50:45.869988 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.869948 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90"} err="failed to get container status \"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90\": rpc error: code = NotFound desc = could not find container \"aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90\": container with ID starting with aa509e6c43c2a4eb4669baff0d51baf493e9538e375be666590d78e852166c90 not found: ID does not exist" Jul 31 14:50:45.883685 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.883664 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:50:45.888226 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:45.888207 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6495f758c4-7f2s7"] Jul 31 14:50:47.102623 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:50:47.102591 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fefb083c-75bc-40a6-8680-e6f19e1bddab" path="/var/lib/kubelet/pods/fefb083c-75bc-40a6-8680-e6f19e1bddab/volumes" Jul 31 14:51:16.043983 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:16.043948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:16.100017 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:16.099984 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:20.358614 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.358580 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:20.359087 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.358986 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="alertmanager" containerID="cri-o://e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" gracePeriod=120 Jul 31 14:51:20.359087 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.359027 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-metric" containerID="cri-o://4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" gracePeriod=120 Jul 31 14:51:20.359193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.359063 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-web" containerID="cri-o://bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" gracePeriod=120 Jul 31 14:51:20.359193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.359087 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy" containerID="cri-o://293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" gracePeriod=120 Jul 31 14:51:20.359193 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.359142 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="prom-label-proxy" containerID="cri-o://9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" gracePeriod=120 Jul 31 14:51:20.359313 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:20.359095 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="config-reloader" containerID="cri-o://809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" gracePeriod=120 Jul 31 14:51:21.000659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000623 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" exitCode=0 Jul 31 14:51:21.000659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000650 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" exitCode=0 Jul 31 14:51:21.000659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000659 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" exitCode=0 Jul 31 14:51:21.000659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000666 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" exitCode=0 Jul 31 14:51:21.000939 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65"} Jul 31 14:51:21.000939 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7"} Jul 31 14:51:21.000939 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264"} Jul 31 14:51:21.000939 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.000821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973"} Jul 31 14:51:21.606646 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.606627 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:21.689925 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.689848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.689925 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.689919 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.689941 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.689959 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.689983 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690023 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690041 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690068 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690100 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690141 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690139 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhrqz\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690175 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690202 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690227 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config\") pod \"73393c0a-dfe7-484d-86fd-7423f13d4d82\" (UID: \"73393c0a-dfe7-484d-86fd-7423f13d4d82\") " Jul 31 14:51:21.690528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690301 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:21.690528 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690514 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.690893 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.690870 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:51:21.691287 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.691214 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:51:21.692995 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.692967 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out" (OuterVolumeSpecName: "config-out") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:51:21.693091 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.693003 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz" (OuterVolumeSpecName: "kube-api-access-vhrqz") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "kube-api-access-vhrqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:51:21.693091 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.693069 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume" (OuterVolumeSpecName: "config-volume") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.693423 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.693384 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.693697 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.693677 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:51:21.693765 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.693695 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.694235 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.694213 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.694725 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.694706 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.697491 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.697415 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.702885 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.702865 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config" (OuterVolumeSpecName: "web-config") pod "73393c0a-dfe7-484d-86fd-7423f13d4d82" (UID: "73393c0a-dfe7-484d-86fd-7423f13d4d82"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:51:21.791032 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791004 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-volume\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791032 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791031 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791042 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-web-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791050 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791072 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-config-out\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791081 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-tls-assets\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791089 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73393c0a-dfe7-484d-86fd-7423f13d4d82-metrics-client-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791097 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhrqz\" (UniqueName: \"kubernetes.io/projected/73393c0a-dfe7-484d-86fd-7423f13d4d82-kube-api-access-vhrqz\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791105 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73393c0a-dfe7-484d-86fd-7423f13d4d82-alertmanager-main-db\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791114 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791122 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-cluster-tls-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:21.791180 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:21.791131 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73393c0a-dfe7-484d-86fd-7423f13d4d82-secret-alertmanager-main-tls\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:51:22.007440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007363 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" exitCode=0 Jul 31 14:51:22.007440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007390 2564 generic.go:356] "Generic (PLEG): container finished" podID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerID="bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" exitCode=0 Jul 31 14:51:22.007440 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007431 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.007706 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5"} Jul 31 14:51:22.007706 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca"} Jul 31 14:51:22.007706 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73393c0a-dfe7-484d-86fd-7423f13d4d82","Type":"ContainerDied","Data":"9af009929edadc6026ed0ae83ef2eb993b4636e926e58cc5150ae2fa41ee7a09"} Jul 31 14:51:22.007706 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.007639 2564 scope.go:117] "RemoveContainer" containerID="9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" Jul 31 14:51:22.016112 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.016096 2564 scope.go:117] "RemoveContainer" containerID="4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" Jul 31 14:51:22.022914 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.022894 2564 scope.go:117] "RemoveContainer" containerID="293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" Jul 31 14:51:22.029277 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.029261 2564 scope.go:117] "RemoveContainer" containerID="bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" Jul 31 14:51:22.035888 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.035859 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:22.039860 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.039839 2564 scope.go:117] "RemoveContainer" containerID="809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" Jul 31 14:51:22.040869 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.040845 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:22.046895 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.046880 2564 scope.go:117] "RemoveContainer" containerID="e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" Jul 31 14:51:22.053824 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.053754 2564 scope.go:117] "RemoveContainer" containerID="823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a" Jul 31 14:51:22.060238 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.060219 2564 scope.go:117] "RemoveContainer" containerID="9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" Jul 31 14:51:22.060508 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.060487 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65\": container with ID starting with 9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65 not found: ID does not exist" containerID="9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" Jul 31 14:51:22.060588 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.060519 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65"} err="failed to get container status \"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65\": rpc error: code = NotFound desc = could not find container \"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65\": container with ID starting with 9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65 not found: ID does not exist" Jul 31 14:51:22.060588 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.060545 2564 scope.go:117] "RemoveContainer" containerID="4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" Jul 31 14:51:22.060801 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.060760 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5\": container with ID starting with 4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5 not found: ID does not exist" containerID="4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" Jul 31 14:51:22.060898 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.060810 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5"} err="failed to get container status \"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5\": rpc error: code = NotFound desc = could not find container \"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5\": container with ID starting with 4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5 not found: ID does not exist" Jul 31 14:51:22.060898 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.060833 2564 scope.go:117] "RemoveContainer" containerID="293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" Jul 31 14:51:22.061135 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.061117 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7\": container with ID starting with 293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7 not found: ID does not exist" containerID="293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" Jul 31 14:51:22.061196 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061139 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7"} err="failed to get container status \"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7\": rpc error: code = NotFound desc = could not find container \"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7\": container with ID starting with 293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7 not found: ID does not exist" Jul 31 14:51:22.061196 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061154 2564 scope.go:117] "RemoveContainer" containerID="bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" Jul 31 14:51:22.061423 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.061405 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca\": container with ID starting with bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca not found: ID does not exist" containerID="bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" Jul 31 14:51:22.061470 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061428 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca"} err="failed to get container status \"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca\": rpc error: code = NotFound desc = could not find container \"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca\": container with ID starting with bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca not found: ID does not exist" Jul 31 14:51:22.061470 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061449 2564 scope.go:117] "RemoveContainer" containerID="809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" Jul 31 14:51:22.061675 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.061661 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264\": container with ID starting with 809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264 not found: ID does not exist" containerID="809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" Jul 31 14:51:22.061710 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061678 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264"} err="failed to get container status \"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264\": rpc error: code = NotFound desc = could not find container \"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264\": container with ID starting with 809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264 not found: ID does not exist" Jul 31 14:51:22.061710 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061690 2564 scope.go:117] "RemoveContainer" containerID="e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" Jul 31 14:51:22.061948 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.061927 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973\": container with ID starting with e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973 not found: ID does not exist" containerID="e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" Jul 31 14:51:22.061995 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061957 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973"} err="failed to get container status \"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973\": rpc error: code = NotFound desc = could not find container \"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973\": container with ID starting with e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973 not found: ID does not exist" Jul 31 14:51:22.062031 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.061995 2564 scope.go:117] "RemoveContainer" containerID="823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a" Jul 31 14:51:22.062229 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:51:22.062214 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a\": container with ID starting with 823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a not found: ID does not exist" containerID="823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a" Jul 31 14:51:22.062266 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062233 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a"} err="failed to get container status \"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a\": rpc error: code = NotFound desc = could not find container \"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a\": container with ID starting with 823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a not found: ID does not exist" Jul 31 14:51:22.062266 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062248 2564 scope.go:117] "RemoveContainer" containerID="9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65" Jul 31 14:51:22.062448 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062431 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65"} err="failed to get container status \"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65\": rpc error: code = NotFound desc = could not find container \"9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65\": container with ID starting with 9a427579d14c3b15bc5ca61b99c1958572d302e2f7ee1fa081f796b8820cfc65 not found: ID does not exist" Jul 31 14:51:22.062489 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062449 2564 scope.go:117] "RemoveContainer" containerID="4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5" Jul 31 14:51:22.062673 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062654 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5"} err="failed to get container status \"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5\": rpc error: code = NotFound desc = could not find container \"4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5\": container with ID starting with 4bbf39249157002bec3eb9b927c7e420bab0eeb3c7f9d4549bc4a7b5ddb7baf5 not found: ID does not exist" Jul 31 14:51:22.062747 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062675 2564 scope.go:117] "RemoveContainer" containerID="293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7" Jul 31 14:51:22.062930 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062912 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7"} err="failed to get container status \"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7\": rpc error: code = NotFound desc = could not find container \"293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7\": container with ID starting with 293b3e498ae0fb76ee50add8ce8221971a9320fbaa1164746048269d28889bb7 not found: ID does not exist" Jul 31 14:51:22.062980 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.062931 2564 scope.go:117] "RemoveContainer" containerID="bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca" Jul 31 14:51:22.063153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063137 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca"} err="failed to get container status \"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca\": rpc error: code = NotFound desc = could not find container \"bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca\": container with ID starting with bed2b60e4be5ab42a4dc37b12e9e00c385207f968ac9cd08f6b005d2ebfc33ca not found: ID does not exist" Jul 31 14:51:22.063199 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063153 2564 scope.go:117] "RemoveContainer" containerID="809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264" Jul 31 14:51:22.063334 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063319 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264"} err="failed to get container status \"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264\": rpc error: code = NotFound desc = could not find container \"809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264\": container with ID starting with 809997c93c163f5ca20cfae7df798a103a5a299df1deaff969eff6508679e264 not found: ID does not exist" Jul 31 14:51:22.063380 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063335 2564 scope.go:117] "RemoveContainer" containerID="e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973" Jul 31 14:51:22.063507 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063492 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973"} err="failed to get container status \"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973\": rpc error: code = NotFound desc = could not find container \"e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973\": container with ID starting with e7e93d62b6e01da0f9908b385f0195afdfcd7f25a64a018bba4a310484d05973 not found: ID does not exist" Jul 31 14:51:22.063545 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063507 2564 scope.go:117] "RemoveContainer" containerID="823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a" Jul 31 14:51:22.063694 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.063680 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a"} err="failed to get container status \"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a\": rpc error: code = NotFound desc = could not find container \"823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a\": container with ID starting with 823a7c8b65180e325198677fd4e2085cbe7d6abef65be308720abdcb215d264a not found: ID does not exist" Jul 31 14:51:22.071986 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.071967 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:22.072235 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072223 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-metric" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072236 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-metric" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072247 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" containerName="console" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072253 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" containerName="console" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072260 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="alertmanager" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072265 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="alertmanager" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072271 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy" Jul 31 14:51:22.072279 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072276 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072283 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="init-config-reloader" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072288 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="init-config-reloader" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072297 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" containerName="registry" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072302 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" containerName="registry" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072307 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3503ff8c-054b-4d47-9893-46902caaa02a" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072312 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3503ff8c-054b-4d47-9893-46902caaa02a" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072322 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefb083c-75bc-40a6-8680-e6f19e1bddab" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072326 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefb083c-75bc-40a6-8680-e6f19e1bddab" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072332 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="prom-label-proxy" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072336 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="prom-label-proxy" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072344 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="config-reloader" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072348 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="config-reloader" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072353 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-web" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072358 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-web" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072396 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-web" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072402 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy-metric" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072408 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7acd90b-a4e5-4dee-a8f8-9ed77e5d6167" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072413 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="config-reloader" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072419 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="prom-label-proxy" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072425 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="kube-rbac-proxy" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072430 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefb083c-75bc-40a6-8680-e6f19e1bddab" containerName="console" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072435 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" containerName="alertmanager" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072440 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d346173c-2381-4318-8a3d-7bd134b81b69" containerName="registry" Jul 31 14:51:22.072494 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.072444 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3503ff8c-054b-4d47-9893-46902caaa02a" containerName="console" Jul 31 14:51:22.078030 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.078014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.082032 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 14:51:22.082155 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 14:51:22.082224 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082135 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 14:51:22.082224 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082218 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 14:51:22.082741 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2l7gm\"" Jul 31 14:51:22.082963 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 14:51:22.082963 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 14:51:22.083090 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.082989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 14:51:22.083318 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.083301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 14:51:22.089976 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.089959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 14:51:22.094245 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.094224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:22.193655 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddqcd\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-kube-api-access-ddqcd\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-out\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.193841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-web-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.194085 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.193979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295216 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddqcd\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-kube-api-access-ddqcd\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-out\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-web-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.295966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.295700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.296537 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.296510 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.297161 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.297134 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f12ea9-4d40-4400-a46a-9a1f876aa305-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298395 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298395 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298557 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298557 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298676 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298594 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298676 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.298966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.298942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f12ea9-4d40-4400-a46a-9a1f876aa305-config-out\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.299422 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.299404 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-web-config\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.300198 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.300182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f12ea9-4d40-4400-a46a-9a1f876aa305-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.303414 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.303399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddqcd\" (UniqueName: \"kubernetes.io/projected/88f12ea9-4d40-4400-a46a-9a1f876aa305-kube-api-access-ddqcd\") pod \"alertmanager-main-0\" (UID: \"88f12ea9-4d40-4400-a46a-9a1f876aa305\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.387468 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.387443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 14:51:22.520753 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:22.520718 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 14:51:22.523529 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:51:22.523494 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f12ea9_4d40_4400_a46a_9a1f876aa305.slice/crio-4dc515d1c6a93c2d0fbfb5f890d9b2d1e4d21cec359acff309c9aa540819ba1c WatchSource:0}: Error finding container 4dc515d1c6a93c2d0fbfb5f890d9b2d1e4d21cec359acff309c9aa540819ba1c: Status 404 returned error can't find the container with id 4dc515d1c6a93c2d0fbfb5f890d9b2d1e4d21cec359acff309c9aa540819ba1c Jul 31 14:51:23.012852 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:23.012817 2564 generic.go:356] "Generic (PLEG): container finished" podID="88f12ea9-4d40-4400-a46a-9a1f876aa305" containerID="d367beefb6a66e806975af26a2e8528062adf6c7e3203c27453ad91fdcb8a4a2" exitCode=0 Jul 31 14:51:23.013230 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:23.012911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerDied","Data":"d367beefb6a66e806975af26a2e8528062adf6c7e3203c27453ad91fdcb8a4a2"} Jul 31 14:51:23.013230 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:23.013007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"4dc515d1c6a93c2d0fbfb5f890d9b2d1e4d21cec359acff309c9aa540819ba1c"} Jul 31 14:51:23.102683 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:23.102658 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73393c0a-dfe7-484d-86fd-7423f13d4d82" path="/var/lib/kubelet/pods/73393c0a-dfe7-484d-86fd-7423f13d4d82/volumes" Jul 31 14:51:24.020181 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"60a224010ccc12046aaed4d9ed4e0fc0da8ad9c70143ee127814069d33016d7b"} Jul 31 14:51:24.020640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"2399863c9f0532cc3d9c3cb2621b99bab3bb9c8109f802db7ee6c106135bebb7"} Jul 31 14:51:24.020640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"07d5f5e894926b4e4e464a72892f38073aa6c4bb406c7eb6baa7aa276b7468cf"} Jul 31 14:51:24.020640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"05cbfcdae84c49e421838f49bf2e86df39dc081a0b66f930ae75f71d843b352c"} Jul 31 14:51:24.020640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"6db722a64db24e0ce4077b066125cdbea6a19e3574d65c89b1863dbbdbc5cebd"} Jul 31 14:51:24.020640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.020398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f12ea9-4d40-4400-a46a-9a1f876aa305","Type":"ContainerStarted","Data":"f384db913a3508f8c779995a5371bb23ad0df0f1b40e44a0d9f817566b567723"} Jul 31 14:51:24.050522 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:24.050470 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.034492541 podStartE2EDuration="2.050453009s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.960468ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:51:24.048499579 +0000 UTC m=+213.419466410" watchObservedRunningTime="2026-07-31 14:51:24.050453009 +0000 UTC m=+213.421419840" Jul 31 14:51:27.900264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:27.900230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:28.001937 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:28.001901 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:36.812163 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.812128 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:51:36.816705 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.816687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.825032 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.825008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:51:36.915464 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915665 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk6rj\" (UniqueName: \"kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915864 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.915864 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.915712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:36.916450 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.916413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:36.974992 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:36.974967 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:37.016096 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk6rj\" (UniqueName: \"kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.016430 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.017016 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.016986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.017114 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.017089 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.017114 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.017107 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.017201 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.017112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.018649 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.018630 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.018753 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.018655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.024849 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.024827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk6rj\" (UniqueName: \"kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj\") pod \"console-b6c7d957b-gh7mg\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.126317 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.126232 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:37.254966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:37.254941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:51:37.256639 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:51:37.256616 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16561277_fae8_4de8_83b9_515c9363d907.slice/crio-19ebc6477434b7fb64047b7f6ed63bc3e501c2722d00e2d9f12968807172a8dd WatchSource:0}: Error finding container 19ebc6477434b7fb64047b7f6ed63bc3e501c2722d00e2d9f12968807172a8dd: Status 404 returned error can't find the container with id 19ebc6477434b7fb64047b7f6ed63bc3e501c2722d00e2d9f12968807172a8dd Jul 31 14:51:38.075863 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:38.075823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c7d957b-gh7mg" event={"ID":"16561277-fae8-4de8-83b9-515c9363d907","Type":"ContainerStarted","Data":"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458"} Jul 31 14:51:38.076244 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:38.075900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c7d957b-gh7mg" event={"ID":"16561277-fae8-4de8-83b9-515c9363d907","Type":"ContainerStarted","Data":"19ebc6477434b7fb64047b7f6ed63bc3e501c2722d00e2d9f12968807172a8dd"} Jul 31 14:51:38.095338 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:38.095290 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6c7d957b-gh7mg" podStartSLOduration=2.095274387 podStartE2EDuration="2.095274387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:51:38.093529828 +0000 UTC m=+227.464496659" watchObservedRunningTime="2026-07-31 14:51:38.095274387 +0000 UTC m=+227.466241218" Jul 31 14:51:42.175657 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:42.175614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:42.276407 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:42.276370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:43.390635 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:43.390599 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:47.126533 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:47.126507 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:47.126894 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:47.126549 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:47.131214 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:47.131192 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:48.115359 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:48.115331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:51:48.156621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:48.156591 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:51:48.264400 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:48.264364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:48.365810 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:48.365707 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:51:48.467357 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:51:48.467320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:13.177913 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.177820 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7559448446-zsjjj" podUID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" containerName="console" containerID="cri-o://4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b" gracePeriod=15 Jul 31 14:52:13.408829 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.408764 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:52:13.496884 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.496820 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.496884 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.496852 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh9dg\" (UniqueName: \"kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.496884 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.496877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.497142 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.496904 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.497142 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.496951 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.497142 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497010 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.497142 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497049 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert\") pod \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\" (UID: \"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1\") " Jul 31 14:52:13.497357 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497201 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:13.497409 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497387 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-oauth-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.497457 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497415 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config" (OuterVolumeSpecName: "console-config") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:13.497457 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497421 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:13.497457 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.497434 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:52:13.499025 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.498993 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:52:13.499150 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.499129 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:52:13.499150 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.499140 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg" (OuterVolumeSpecName: "kube-api-access-bh9dg") pod "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" (UID: "44fe4b6b-8d78-466b-8c27-ce93bb84cbb1"). InnerVolumeSpecName "kube-api-access-bh9dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:52:13.597688 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597667 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.597688 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597687 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.597830 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597697 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh9dg\" (UniqueName: \"kubernetes.io/projected/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-kube-api-access-bh9dg\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.597830 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597705 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-console-oauth-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.597830 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597714 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-trusted-ca-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:13.597830 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:13.597722 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1-service-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:52:14.206375 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.206341 2564 generic.go:356] "Generic (PLEG): container finished" podID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" containerID="4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b" exitCode=0 Jul 31 14:52:14.206739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.206379 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7559448446-zsjjj" Jul 31 14:52:14.206739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.206398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7559448446-zsjjj" event={"ID":"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1","Type":"ContainerDied","Data":"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b"} Jul 31 14:52:14.206739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.206442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7559448446-zsjjj" event={"ID":"44fe4b6b-8d78-466b-8c27-ce93bb84cbb1","Type":"ContainerDied","Data":"838139ba6c3780127dd5ec5edfcdd29576b51fc3b8e7313a30b5de69236a3d06"} Jul 31 14:52:14.206739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.206463 2564 scope.go:117] "RemoveContainer" containerID="4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b" Jul 31 14:52:14.215169 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.215153 2564 scope.go:117] "RemoveContainer" containerID="4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b" Jul 31 14:52:14.215448 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:52:14.215431 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b\": container with ID starting with 4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b not found: ID does not exist" containerID="4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b" Jul 31 14:52:14.215496 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.215456 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b"} err="failed to get container status \"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b\": rpc error: code = NotFound desc = could not find container \"4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b\": container with ID starting with 4d8f6546c7b93cd82afa60a5c3153e397bc7c2b23d96d63e6e20fba9f7d3cb5b not found: ID does not exist" Jul 31 14:52:14.228347 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.228328 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:52:14.232426 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:14.232409 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7559448446-zsjjj"] Jul 31 14:52:15.103448 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:15.103417 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" path="/var/lib/kubelet/pods/44fe4b6b-8d78-466b-8c27-ce93bb84cbb1/volumes" Jul 31 14:52:21.076015 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:21.075983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:21.176358 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:21.176324 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:52:51.049375 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:52:51.049347 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 14:53:11.521577 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:11.521537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:53:19.487807 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:19.487759 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:53:39.737597 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:39.737556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:53:39.832252 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:39.832218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:53:39.902623 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:39.902601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:53:40.925811 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.925764 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x"] Jul 31 14:53:40.926166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.926048 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" containerName="console" Jul 31 14:53:40.926166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.926058 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" containerName="console" Jul 31 14:53:40.926166 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.926103 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44fe4b6b-8d78-466b-8c27-ce93bb84cbb1" containerName="console" Jul 31 14:53:40.929020 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.929005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:40.931313 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.931289 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 31 14:53:40.932339 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.932314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fzgrz\"" Jul 31 14:53:40.932739 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.932339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 31 14:53:40.940827 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:40.940797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x"] Jul 31 14:53:41.008429 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.008403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.008553 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.008448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfdb7\" (UniqueName: \"kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.008553 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.008468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.109819 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.109763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.109942 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.109859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfdb7\" (UniqueName: \"kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.109942 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.109881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.110150 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.110131 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.110213 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.110161 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.118143 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.118124 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfdb7\" (UniqueName: \"kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.243917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.243842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:41.367508 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.367486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x"] Jul 31 14:53:41.370094 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:53:41.370057 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c0c64d_7e5d_49fd_a171_d028e8a9d85c.slice/crio-158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5 WatchSource:0}: Error finding container 158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5: Status 404 returned error can't find the container with id 158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5 Jul 31 14:53:41.371951 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.371935 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:53:41.517120 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:41.517087 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" event={"ID":"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c","Type":"ContainerStarted","Data":"158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5"} Jul 31 14:53:47.542503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:47.542463 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerID="5e27fcd18f5f1f048d40e4ac75bf1ad83b7104fa445c1e35386bbf9a1687b806" exitCode=0 Jul 31 14:53:47.542910 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:47.542528 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" event={"ID":"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c","Type":"ContainerDied","Data":"5e27fcd18f5f1f048d40e4ac75bf1ad83b7104fa445c1e35386bbf9a1687b806"} Jul 31 14:53:50.559011 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:50.558978 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerID="92d6e79e04b246fbc43ebd4efe4f74e86c37338c34627220963b0f20df520d86" exitCode=0 Jul 31 14:53:50.559492 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:50.559041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" event={"ID":"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c","Type":"ContainerDied","Data":"92d6e79e04b246fbc43ebd4efe4f74e86c37338c34627220963b0f20df520d86"} Jul 31 14:53:57.592601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:57.592566 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerID="f74da2168936280378112ce79ae8e1b769a451d401c7aa21723575553065dd19" exitCode=0 Jul 31 14:53:57.593007 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:57.592610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" event={"ID":"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c","Type":"ContainerDied","Data":"f74da2168936280378112ce79ae8e1b769a451d401c7aa21723575553065dd19"} Jul 31 14:53:58.718896 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.718873 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:58.857621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.857541 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util\") pod \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " Jul 31 14:53:58.857621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.857594 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle\") pod \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " Jul 31 14:53:58.857845 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.857628 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfdb7\" (UniqueName: \"kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7\") pod \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\" (UID: \"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c\") " Jul 31 14:53:58.858252 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.858228 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle" (OuterVolumeSpecName: "bundle") pod "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" (UID: "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:53:58.859797 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.859762 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7" (OuterVolumeSpecName: "kube-api-access-wfdb7") pod "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" (UID: "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c"). InnerVolumeSpecName "kube-api-access-wfdb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:53:58.862138 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.862110 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util" (OuterVolumeSpecName: "util") pod "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" (UID: "d4c0c64d-7e5d-49fd-a171-d028e8a9d85c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:53:58.958991 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.958946 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:53:58.958991 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.958986 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfdb7\" (UniqueName: \"kubernetes.io/projected/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-kube-api-access-wfdb7\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:53:58.958991 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:58.958999 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4c0c64d-7e5d-49fd-a171-d028e8a9d85c-util\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:53:59.602436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:59.602400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" event={"ID":"d4c0c64d-7e5d-49fd-a171-d028e8a9d85c","Type":"ContainerDied","Data":"158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5"} Jul 31 14:53:59.602436 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:59.602428 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5znl9x" Jul 31 14:53:59.602622 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:53:59.602490 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="158b098f95e2876ca7f9a5928391e1a717e44b398f8007b6412587365a08c7b5" Jul 31 14:54:02.360729 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:02.360691 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:03.705349 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.705312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:03.753170 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753139 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t"] Jul 31 14:54:03.753428 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753416 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="pull" Jul 31 14:54:03.753469 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753430 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="pull" Jul 31 14:54:03.753469 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753439 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="extract" Jul 31 14:54:03.753469 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753448 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="extract" Jul 31 14:54:03.753469 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753464 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="util" Jul 31 14:54:03.753469 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753469 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="util" Jul 31 14:54:03.753621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.753527 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c0c64d-7e5d-49fd-a171-d028e8a9d85c" containerName="extract" Jul 31 14:54:03.816554 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.816526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t"] Jul 31 14:54:03.816677 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.816623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:03.819353 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.819333 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 31 14:54:03.819563 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.819541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-8mc7x\"" Jul 31 14:54:03.819893 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.819876 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 31 14:54:03.819984 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.819934 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 31 14:54:03.900584 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.900562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/59897f48-6588-4fc6-93af-e502d59b8e92-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:03.900693 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:03.900595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wvxl\" (UniqueName: \"kubernetes.io/projected/59897f48-6588-4fc6-93af-e502d59b8e92-kube-api-access-9wvxl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.000966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.000910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/59897f48-6588-4fc6-93af-e502d59b8e92-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.000966 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.000943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wvxl\" (UniqueName: \"kubernetes.io/projected/59897f48-6588-4fc6-93af-e502d59b8e92-kube-api-access-9wvxl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.003117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.003094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/59897f48-6588-4fc6-93af-e502d59b8e92-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.021219 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.021197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wvxl\" (UniqueName: \"kubernetes.io/projected/59897f48-6588-4fc6-93af-e502d59b8e92-kube-api-access-9wvxl\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-ll98t\" (UID: \"59897f48-6588-4fc6-93af-e502d59b8e92\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.126171 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.126126 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:04.279674 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.279646 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t"] Jul 31 14:54:04.282698 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:54:04.282666 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59897f48_6588_4fc6_93af_e502d59b8e92.slice/crio-0ff247134decf1d08cf19010574c6ccef7769f3f695140d5cd089f463f0c25fd WatchSource:0}: Error finding container 0ff247134decf1d08cf19010574c6ccef7769f3f695140d5cd089f463f0c25fd: Status 404 returned error can't find the container with id 0ff247134decf1d08cf19010574c6ccef7769f3f695140d5cd089f463f0c25fd Jul 31 14:54:04.622857 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:04.622761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" event={"ID":"59897f48-6588-4fc6-93af-e502d59b8e92","Type":"ContainerStarted","Data":"0ff247134decf1d08cf19010574c6ccef7769f3f695140d5cd089f463f0c25fd"} Jul 31 14:54:08.137334 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.137299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:08.450565 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.450488 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:08.450720 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.450698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-j297f"] Jul 31 14:54:08.474573 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.474549 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-j297f"] Jul 31 14:54:08.474685 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.474639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.476934 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.476911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 31 14:54:08.477050 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.476953 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 31 14:54:08.477050 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.476977 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-pdh2z\"" Jul 31 14:54:08.536744 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.536723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.536883 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.536756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqstm\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-kube-api-access-wqstm\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.536883 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.536842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-cabundle0\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.637502 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.637471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.637502 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.637507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqstm\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-kube-api-access-wqstm\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.637722 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.637530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-cabundle0\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.637722 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.637648 2564 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 31 14:54:08.637722 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.637669 2564 secret.go:281] references non-existent secret key: ca.crt Jul 31 14:54:08.637722 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.637680 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 31 14:54:08.637722 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.637695 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-j297f: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 31 14:54:08.637995 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.637748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates podName:c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68 nodeName:}" failed. No retries permitted until 2026-07-31 14:54:09.13772992 +0000 UTC m=+378.508696745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates") pod "keda-operator-77f648d694-j297f" (UID: "c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 31 14:54:08.638154 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.638137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-cabundle0\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.641090 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.641066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" event={"ID":"59897f48-6588-4fc6-93af-e502d59b8e92","Type":"ContainerStarted","Data":"60ff6e74a94eb6a566218e109d9810ab16658242b836e1f461a4e4a6579dd673"} Jul 31 14:54:08.641210 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.641172 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:08.660369 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.660343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqstm\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-kube-api-access-wqstm\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:08.667533 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.667492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:08.686843 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.686802 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" podStartSLOduration=2.3741187 podStartE2EDuration="5.686768721s" totalImagesPullingTime="3.312650021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:08.684991219 +0000 UTC m=+378.055958049" watchObservedRunningTime="2026-07-31 14:54:08.686768721 +0000 UTC m=+378.057735552" Jul 31 14:54:08.711551 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.711505 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf"] Jul 31 14:54:08.730992 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.730971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf"] Jul 31 14:54:08.731090 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.731060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.733625 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.733608 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 31 14:54:08.758537 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.758511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:08.832183 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.832146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:08.838718 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.838694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/18d6550a-a00d-4133-b768-0ecb0c49108d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.838819 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.838727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.838819 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.838752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9lv\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-kube-api-access-xq9lv\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.940153 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.940125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/18d6550a-a00d-4133-b768-0ecb0c49108d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.940277 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.940161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.940277 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.940198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9lv\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-kube-api-access-xq9lv\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.940354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.940281 2564 secret.go:281] references non-existent secret key: tls.crt Jul 31 14:54:08.940354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.940297 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 31 14:54:08.940354 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.940313 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf: references non-existent secret key: tls.crt Jul 31 14:54:08.940460 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:08.940360 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates podName:18d6550a-a00d-4133-b768-0ecb0c49108d nodeName:}" failed. No retries permitted until 2026-07-31 14:54:09.440346562 +0000 UTC m=+378.811313370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates") pod "keda-metrics-apiserver-55557df8c-nv7hf" (UID: "18d6550a-a00d-4133-b768-0ecb0c49108d") : references non-existent secret key: tls.crt Jul 31 14:54:08.940601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.940585 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/18d6550a-a00d-4133-b768-0ecb0c49108d-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:08.948323 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:08.948293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9lv\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-kube-api-access-xq9lv\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:09.141396 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.141361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:09.141749 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:09.141469 2564 secret.go:281] references non-existent secret key: ca.crt Jul 31 14:54:09.141749 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:09.141481 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 31 14:54:09.141749 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:09.141489 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-j297f: references non-existent secret key: ca.crt Jul 31 14:54:09.141749 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:54:09.141537 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates podName:c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68 nodeName:}" failed. No retries permitted until 2026-07-31 14:54:10.141521779 +0000 UTC m=+379.512488606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates") pod "keda-operator-77f648d694-j297f" (UID: "c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68") : references non-existent secret key: ca.crt Jul 31 14:54:09.203621 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.203589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:09.375925 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.375897 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-mtrcg"] Jul 31 14:54:09.397568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.397497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-mtrcg"] Jul 31 14:54:09.397685 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.397615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.400040 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.400018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 31 14:54:09.400879 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.400852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:09.443702 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.443677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:09.446342 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.446315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/18d6550a-a00d-4133-b768-0ecb0c49108d-certificates\") pod \"keda-metrics-apiserver-55557df8c-nv7hf\" (UID: \"18d6550a-a00d-4133-b768-0ecb0c49108d\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:09.502163 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.502098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:09.544264 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.544228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mww\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-kube-api-access-56mww\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.544424 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.544334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-certificates\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.601219 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.601185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:09.642088 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.642049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:09.644910 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.644882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mww\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-kube-api-access-56mww\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.645048 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.644931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-certificates\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.648042 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.647978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-certificates\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.653227 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.653204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mww\" (UniqueName: \"kubernetes.io/projected/85ffb706-91ac-48ea-bbc1-0fa42e04258e-kube-api-access-56mww\") pod \"keda-admission-56f9798bb4-mtrcg\" (UID: \"85ffb706-91ac-48ea-bbc1-0fa42e04258e\") " pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.708170 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.708138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:09.818597 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.818516 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf"] Jul 31 14:54:09.821675 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:54:09.821425 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d6550a_a00d_4133_b768_0ecb0c49108d.slice/crio-72c287f53b178a124f3b9bed77413f7ed941e01706be9a4dea08003bad00e59e WatchSource:0}: Error finding container 72c287f53b178a124f3b9bed77413f7ed941e01706be9a4dea08003bad00e59e: Status 404 returned error can't find the container with id 72c287f53b178a124f3b9bed77413f7ed941e01706be9a4dea08003bad00e59e Jul 31 14:54:09.883222 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.883182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-mtrcg"] Jul 31 14:54:09.887901 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:54:09.887874 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ffb706_91ac_48ea_bbc1_0fa42e04258e.slice/crio-61483d82457ed4fda8d8ef37c087d7d286be651d2003871305677f7720e5e192 WatchSource:0}: Error finding container 61483d82457ed4fda8d8ef37c087d7d286be651d2003871305677f7720e5e192: Status 404 returned error can't find the container with id 61483d82457ed4fda8d8ef37c087d7d286be651d2003871305677f7720e5e192 Jul 31 14:54:09.978463 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:09.978314 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:10.150088 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.150053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:10.152359 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.152335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68-certificates\") pod \"keda-operator-77f648d694-j297f\" (UID: \"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68\") " pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:10.221809 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.221756 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:10.284389 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.284364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:10.380541 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.380464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:10.406973 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.406948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-j297f"] Jul 31 14:54:10.409393 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:54:10.409367 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c82ff2_b869_4bf3_ad17_1c6dd23d2c68.slice/crio-40b92ad09dc343875fb4a473c94a0251c173fb1f3e7cb34609a8fcd7dc6675af WatchSource:0}: Error finding container 40b92ad09dc343875fb4a473c94a0251c173fb1f3e7cb34609a8fcd7dc6675af: Status 404 returned error can't find the container with id 40b92ad09dc343875fb4a473c94a0251c173fb1f3e7cb34609a8fcd7dc6675af Jul 31 14:54:10.480456 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.480431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:10.595625 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.595532 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:10.653831 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.653796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-j297f" event={"ID":"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68","Type":"ContainerStarted","Data":"40b92ad09dc343875fb4a473c94a0251c173fb1f3e7cb34609a8fcd7dc6675af"} Jul 31 14:54:10.655610 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.655566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" event={"ID":"18d6550a-a00d-4133-b768-0ecb0c49108d","Type":"ContainerStarted","Data":"72c287f53b178a124f3b9bed77413f7ed941e01706be9a4dea08003bad00e59e"} Jul 31 14:54:10.657012 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.656988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" event={"ID":"85ffb706-91ac-48ea-bbc1-0fa42e04258e","Type":"ContainerStarted","Data":"61483d82457ed4fda8d8ef37c087d7d286be651d2003871305677f7720e5e192"} Jul 31 14:54:10.726397 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:10.726358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:12.479434 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:12.479392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:12.582723 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:12.582677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:12.668172 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:12.668134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" event={"ID":"85ffb706-91ac-48ea-bbc1-0fa42e04258e","Type":"ContainerStarted","Data":"9ac4fb6c73965547fc10936b99547df60e37f7a7709c5c80571a38a3571734be"} Jul 31 14:54:12.668330 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:12.668248 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:12.689093 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:12.689005 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" podStartSLOduration=1.0793330270000001 podStartE2EDuration="3.688985695s" totalImagesPullingTime="2.609652668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:12.686464336 +0000 UTC m=+382.057431189" watchObservedRunningTime="2026-07-31 14:54:12.688985695 +0000 UTC m=+382.059952522" Jul 31 14:54:13.673423 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:13.673398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" event={"ID":"18d6550a-a00d-4133-b768-0ecb0c49108d","Type":"ContainerStarted","Data":"af77c78caa6b39f8904027553642f0ff82c14da0c9363f0c6ba0610c4b0955b3"} Jul 31 14:54:13.673752 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:13.673605 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:13.694602 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:13.694563 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" podStartSLOduration=2.959544235 podStartE2EDuration="5.694546936s" totalImagesPullingTime="2.735002701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:13.692464438 +0000 UTC m=+383.063431294" watchObservedRunningTime="2026-07-31 14:54:13.694546936 +0000 UTC m=+383.065513767" Jul 31 14:54:14.679363 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:14.679331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-j297f" event={"ID":"c3c82ff2-b869-4bf3-ad17-1c6dd23d2c68","Type":"ContainerStarted","Data":"6838f47796aa52fb907b468f71d63997a06fcc332c0434c08cb1d0ae97a9a2b9"} Jul 31 14:54:14.679730 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:14.679508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:14.704100 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:14.704060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-j297f" podStartSLOduration=3.46788682 podStartE2EDuration="6.704046181s" totalImagesPullingTime="3.236159361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:14.702558055 +0000 UTC m=+384.073524906" watchObservedRunningTime="2026-07-31 14:54:14.704046181 +0000 UTC m=+384.075013012" Jul 31 14:54:24.683961 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:24.683929 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nv7hf" Jul 31 14:54:29.648117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:29.648083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-ll98t" Jul 31 14:54:33.675887 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:33.675855 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-mtrcg" Jul 31 14:54:35.685943 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:35.685912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-j297f" Jul 31 14:54:52.969024 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:52.968990 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7ff89555-62gtk"] Jul 31 14:54:52.974604 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:52.974583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:52.983626 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:52.983607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7ff89555-62gtk"] Jul 31 14:54:53.057242 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.057208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:53.067821 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.067794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-oauth-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.067933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.067835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-service-ca\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.067933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.067899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-trusted-ca-bundle\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.068012 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.067959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmzf\" (UniqueName: \"kubernetes.io/projected/2a76701e-1562-45a8-a139-06534a3282f4-kube-api-access-hrmzf\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.068012 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.068001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-oauth-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.068084 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.068021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-console-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.068084 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.068040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.155816 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.155787 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:54:53.168801 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-oauth-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.168917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-console-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.168917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.168917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-oauth-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.168917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-service-ca\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.168917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-trusted-ca-bundle\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.169154 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.168965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmzf\" (UniqueName: \"kubernetes.io/projected/2a76701e-1562-45a8-a139-06534a3282f4-kube-api-access-hrmzf\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.169634 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.169599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-oauth-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.169634 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.169608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-console-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.169850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.169829 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-trusted-ca-bundle\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.169914 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.169833 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a76701e-1562-45a8-a139-06534a3282f4-service-ca\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.171348 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.171325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-oauth-config\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.171443 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.171413 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a76701e-1562-45a8-a139-06534a3282f4-console-serving-cert\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.178576 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.178558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmzf\" (UniqueName: \"kubernetes.io/projected/2a76701e-1562-45a8-a139-06534a3282f4-kube-api-access-hrmzf\") pod \"console-6d7ff89555-62gtk\" (UID: \"2a76701e-1562-45a8-a139-06534a3282f4\") " pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.283645 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.283622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:54:53.416329 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.416306 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7ff89555-62gtk"] Jul 31 14:54:53.417927 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:54:53.417896 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a76701e_1562_45a8_a139_06534a3282f4.slice/crio-26144cc53123f029defcef4b8dbd62c364848280ae7a96d522c52fc7a12d4bf7 WatchSource:0}: Error finding container 26144cc53123f029defcef4b8dbd62c364848280ae7a96d522c52fc7a12d4bf7: Status 404 returned error can't find the container with id 26144cc53123f029defcef4b8dbd62c364848280ae7a96d522c52fc7a12d4bf7 Jul 31 14:54:53.842626 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.842590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7ff89555-62gtk" event={"ID":"2a76701e-1562-45a8-a139-06534a3282f4","Type":"ContainerStarted","Data":"635118e0aebe4e1f76a57575a9ae182bcb98fbbe65aa32589d52af0d31eede10"} Jul 31 14:54:53.842841 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.842648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7ff89555-62gtk" event={"ID":"2a76701e-1562-45a8-a139-06534a3282f4","Type":"ContainerStarted","Data":"26144cc53123f029defcef4b8dbd62c364848280ae7a96d522c52fc7a12d4bf7"} Jul 31 14:54:53.862570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:54:53.862532 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7ff89555-62gtk" podStartSLOduration=1.862517897 podStartE2EDuration="1.862517897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:54:53.861356923 +0000 UTC m=+423.232323775" watchObservedRunningTime="2026-07-31 14:54:53.862517897 +0000 UTC m=+423.233484727" Jul 31 14:55:01.171140 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:01.171103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:01.277965 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:01.277922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:03.284752 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:03.284721 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:55:03.285200 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:03.284785 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:55:03.289585 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:03.289565 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:55:03.888669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:03.888643 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7ff89555-62gtk" Jul 31 14:55:03.943495 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:03.943464 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:55:04.067267 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:04.067226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:04.279482 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:04.279446 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:04.377486 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:04.377451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.146580 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.146544 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.230787 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.230748 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-6rt4r"] Jul 31 14:55:28.234225 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.234204 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.237737 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.237716 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 31 14:55:28.237850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.237716 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 31 14:55:28.237850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.237802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-nn9l4\"" Jul 31 14:55:28.237850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.237802 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 31 14:55:28.247351 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.247332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-6rt4r"] Jul 31 14:55:28.253882 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.253860 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.327799 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.327757 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.344902 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.344876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhbg\" (UniqueName: \"kubernetes.io/projected/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-kube-api-access-hwhbg\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.345011 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.344910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-cert\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.428828 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.428752 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.445816 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.445769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhbg\" (UniqueName: \"kubernetes.io/projected/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-kube-api-access-hwhbg\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.445875 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.445830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-cert\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.448000 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.447979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-cert\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.455650 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.455628 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhbg\" (UniqueName: \"kubernetes.io/projected/ae8bc0f3-99ca-44cf-bb80-bcbe09071323-kube-api-access-hwhbg\") pod \"llmisvc-controller-manager-654c557856-6rt4r\" (UID: \"ae8bc0f3-99ca-44cf-bb80-bcbe09071323\") " pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.544752 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.544726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:28.669282 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.669259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-6rt4r"] Jul 31 14:55:28.671344 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:55:28.671313 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae8bc0f3_99ca_44cf_bb80_bcbe09071323.slice/crio-80f4ee1be1357504734d36365025fe1aacdd83abbeb45acaa1f9cf1659221a8d WatchSource:0}: Error finding container 80f4ee1be1357504734d36365025fe1aacdd83abbeb45acaa1f9cf1659221a8d: Status 404 returned error can't find the container with id 80f4ee1be1357504734d36365025fe1aacdd83abbeb45acaa1f9cf1659221a8d Jul 31 14:55:28.817813 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.817735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.918953 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.918918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.966214 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.966190 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b6c7d957b-gh7mg" podUID="16561277-fae8-4de8-83b9-515c9363d907" containerName="console" containerID="cri-o://c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458" gracePeriod=15 Jul 31 14:55:28.978574 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.978551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:55:28.990916 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:28.990894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" event={"ID":"ae8bc0f3-99ca-44cf-bb80-bcbe09071323","Type":"ContainerStarted","Data":"80f4ee1be1357504734d36365025fe1aacdd83abbeb45acaa1f9cf1659221a8d"} Jul 31 14:55:29.198146 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.198123 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:55:29.354431 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354351 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354431 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk6rj\" (UniqueName: \"kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354439 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354597 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354627 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354669 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354659 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config\") pod \"16561277-fae8-4de8-83b9-515c9363d907\" (UID: \"16561277-fae8-4de8-83b9-515c9363d907\") " Jul 31 14:55:29.354977 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354764 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca" (OuterVolumeSpecName: "service-ca") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:29.354977 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.354858 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:29.355152 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.355003 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:29.355152 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.355015 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-service-ca\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.355152 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.355045 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-trusted-ca-bundle\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.355321 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.355192 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config" (OuterVolumeSpecName: "console-config") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:55:29.356886 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.356853 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:55:29.357017 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.356940 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj" (OuterVolumeSpecName: "kube-api-access-mk6rj") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "kube-api-access-mk6rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:55:29.357017 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.356946 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16561277-fae8-4de8-83b9-515c9363d907" (UID: "16561277-fae8-4de8-83b9-515c9363d907"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:55:29.456302 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.456274 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk6rj\" (UniqueName: \"kubernetes.io/projected/16561277-fae8-4de8-83b9-515c9363d907-kube-api-access-mk6rj\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.456302 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.456300 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.456488 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.456309 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-oauth-serving-cert\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.456488 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.456318 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16561277-fae8-4de8-83b9-515c9363d907-console-oauth-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.456488 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.456326 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16561277-fae8-4de8-83b9-515c9363d907-console-config\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:55:29.997119 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.997050 2564 generic.go:356] "Generic (PLEG): container finished" podID="16561277-fae8-4de8-83b9-515c9363d907" containerID="c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458" exitCode=0 Jul 31 14:55:29.997119 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.997099 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6c7d957b-gh7mg" Jul 31 14:55:29.997342 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.997127 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c7d957b-gh7mg" event={"ID":"16561277-fae8-4de8-83b9-515c9363d907","Type":"ContainerDied","Data":"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458"} Jul 31 14:55:29.997342 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.997177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6c7d957b-gh7mg" event={"ID":"16561277-fae8-4de8-83b9-515c9363d907","Type":"ContainerDied","Data":"19ebc6477434b7fb64047b7f6ed63bc3e501c2722d00e2d9f12968807172a8dd"} Jul 31 14:55:29.997342 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:29.997208 2564 scope.go:117] "RemoveContainer" containerID="c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458" Jul 31 14:55:30.015392 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:30.015368 2564 scope.go:117] "RemoveContainer" containerID="c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458" Jul 31 14:55:30.015668 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:55:30.015643 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458\": container with ID starting with c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458 not found: ID does not exist" containerID="c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458" Jul 31 14:55:30.015733 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:30.015679 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458"} err="failed to get container status \"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458\": rpc error: code = NotFound desc = could not find container \"c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458\": container with ID starting with c8ccc3cff710b6c56d3756f1f34e16753bcbc23b9aecaeeb4e56baa5b3dfd458 not found: ID does not exist" Jul 31 14:55:30.022660 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:30.022636 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:55:30.027190 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:30.027170 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6c7d957b-gh7mg"] Jul 31 14:55:31.106259 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:31.106217 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16561277-fae8-4de8-83b9-515c9363d907" path="/var/lib/kubelet/pods/16561277-fae8-4de8-83b9-515c9363d907/volumes" Jul 31 14:55:32.010051 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:32.010011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" event={"ID":"ae8bc0f3-99ca-44cf-bb80-bcbe09071323","Type":"ContainerStarted","Data":"5b16cd6839ebdc0c7ce40480b37f8768b6f848e8eaca04fb6afb987df81f5448"} Jul 31 14:55:32.010219 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:32.010198 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:55:32.035791 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:55:32.035737 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" podStartSLOduration=1.415807373 podStartE2EDuration="4.035722196s" totalImagesPullingTime="2.619914823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:55:32.035313089 +0000 UTC m=+461.406279921" watchObservedRunningTime="2026-07-31 14:55:32.035722196 +0000 UTC m=+461.406689025" Jul 31 14:56:03.016760 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:03.016729 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-6rt4r" Jul 31 14:56:05.597174 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:05.597129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:46.418295 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.418219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:46.465229 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.465185 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-gxx97"] Jul 31 14:56:46.465521 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.465510 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16561277-fae8-4de8-83b9-515c9363d907" containerName="console" Jul 31 14:56:46.465568 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.465522 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="16561277-fae8-4de8-83b9-515c9363d907" containerName="console" Jul 31 14:56:46.465602 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.465585 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="16561277-fae8-4de8-83b9-515c9363d907" containerName="console" Jul 31 14:56:46.468371 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.468355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.471478 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.471456 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 31 14:56:46.472727 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.472710 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-mpxdj\"" Jul 31 14:56:46.480420 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.480396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gxx97"] Jul 31 14:56:46.499207 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.499188 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-8588677cfb-v4tgj"] Jul 31 14:56:46.502555 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.502537 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.505562 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.505544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 31 14:56:46.506049 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.506035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-wfgnq\"" Jul 31 14:56:46.506358 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.506342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\"" Jul 31 14:56:46.523735 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.523714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-v4tgj"] Jul 31 14:56:46.531318 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.531282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:46.556820 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.556797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.556918 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.556842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlfx\" (UniqueName: \"kubernetes.io/projected/9444b980-328c-41f3-af76-6d12bcd96780-kube-api-access-vxlfx\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.657586 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.657559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.657695 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.657590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjglq\" (UniqueName: \"kubernetes.io/projected/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-kube-api-access-zjglq\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.657695 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.657614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.657695 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.657667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlfx\" (UniqueName: \"kubernetes.io/projected/9444b980-328c-41f3-af76-6d12bcd96780-kube-api-access-vxlfx\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.657888 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.657730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-metrics-certs\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.657888 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:56:46.657746 2564 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 31 14:56:46.657888 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:56:46.657834 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs podName:9444b980-328c-41f3-af76-6d12bcd96780 nodeName:}" failed. No retries permitted until 2026-07-31 14:56:47.157813101 +0000 UTC m=+536.528779918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs") pod "model-serving-api-7b954ffc95-gxx97" (UID: "9444b980-328c-41f3-af76-6d12bcd96780") : secret "model-serving-api-tls" not found Jul 31 14:56:46.669188 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.669142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlfx\" (UniqueName: \"kubernetes.io/projected/9444b980-328c-41f3-af76-6d12bcd96780-kube-api-access-vxlfx\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:46.758788 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.758746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.758885 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.758800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjglq\" (UniqueName: \"kubernetes.io/projected/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-kube-api-access-zjglq\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.758933 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:56:46.758900 2564 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 31 14:56:46.758933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.758911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-metrics-certs\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.759006 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:56:46.758958 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert podName:dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c nodeName:}" failed. No retries permitted until 2026-07-31 14:56:47.258940273 +0000 UTC m=+536.629907099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert") pod "odh-model-controller-8588677cfb-v4tgj" (UID: "dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c") : secret "odh-model-controller-webhook-cert" not found Jul 31 14:56:46.761137 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.761119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-metrics-certs\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.776018 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.775993 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjglq\" (UniqueName: \"kubernetes.io/projected/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-kube-api-access-zjglq\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:46.800093 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.800067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:46.901466 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:46.901437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:47.162509 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.162477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:47.164726 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.164707 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9444b980-328c-41f3-af76-6d12bcd96780-tls-certs\") pod \"model-serving-api-7b954ffc95-gxx97\" (UID: \"9444b980-328c-41f3-af76-6d12bcd96780\") " pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:47.263402 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.263366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:47.265728 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.265705 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c-cert\") pod \"odh-model-controller-8588677cfb-v4tgj\" (UID: \"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c\") " pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:47.378128 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.378088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:47.378640 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.378609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:47.412478 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.412447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:47.476812 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.476571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:56:47.527321 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.527296 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gxx97"] Jul 31 14:56:47.529862 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:56:47.529838 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9444b980_328c_41f3_af76_6d12bcd96780.slice/crio-bb5067bbc0be18e748bfec25b11483ee4049d19f1ac1bf4e44019bd9731e3539 WatchSource:0}: Error finding container bb5067bbc0be18e748bfec25b11483ee4049d19f1ac1bf4e44019bd9731e3539: Status 404 returned error can't find the container with id bb5067bbc0be18e748bfec25b11483ee4049d19f1ac1bf4e44019bd9731e3539 Jul 31 14:56:47.563570 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:47.563549 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-v4tgj"] Jul 31 14:56:47.566038 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:56:47.566013 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdf2e7c_af58_4b7d_8a62_bf40ad56fd1c.slice/crio-92d906a995586b5827730537874c1dc5d12270cc66dbf182dadbfe8df7fd65db WatchSource:0}: Error finding container 92d906a995586b5827730537874c1dc5d12270cc66dbf182dadbfe8df7fd65db: Status 404 returned error can't find the container with id 92d906a995586b5827730537874c1dc5d12270cc66dbf182dadbfe8df7fd65db Jul 31 14:56:48.323117 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:48.322198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gxx97" event={"ID":"9444b980-328c-41f3-af76-6d12bcd96780","Type":"ContainerStarted","Data":"bb5067bbc0be18e748bfec25b11483ee4049d19f1ac1bf4e44019bd9731e3539"} Jul 31 14:56:48.323740 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:48.323709 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-v4tgj" event={"ID":"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c","Type":"ContainerStarted","Data":"92d906a995586b5827730537874c1dc5d12270cc66dbf182dadbfe8df7fd65db"} Jul 31 14:56:51.341895 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.341794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gxx97" event={"ID":"9444b980-328c-41f3-af76-6d12bcd96780","Type":"ContainerStarted","Data":"13d3942a95fd4432131fbd9fcc479a94171569c50fbedc825026d2ceb106ce53"} Jul 31 14:56:51.341895 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.341861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:56:51.343281 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.343257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-v4tgj" event={"ID":"dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c","Type":"ContainerStarted","Data":"b4f517e8a6a5c5f5ee9c2cbae1ff37c5d677f3c8351557399425cb5017cb8f80"} Jul 31 14:56:51.343370 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.343305 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:56:51.364412 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.364375 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-gxx97" podStartSLOduration=1.806502284 podStartE2EDuration="5.364362443s" totalImagesPullingTime="3.557860159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:56:51.363256604 +0000 UTC m=+540.734223435" watchObservedRunningTime="2026-07-31 14:56:51.364362443 +0000 UTC m=+540.735329274" Jul 31 14:56:51.382990 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:51.382928 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-8588677cfb-v4tgj" podStartSLOduration=1.818526022 podStartE2EDuration="5.382910829s" totalImagesPullingTime="3.564384807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:56:51.382314039 +0000 UTC m=+540.753280895" watchObservedRunningTime="2026-07-31 14:56:51.382910829 +0000 UTC m=+540.753877719" Jul 31 14:56:55.265396 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:56:55.265361 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:57:02.350625 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:57:02.350585 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-8588677cfb-v4tgj" Jul 31 14:57:02.352364 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:57:02.352345 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-gxx97" Jul 31 14:57:35.269448 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:57:35.269410 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:23.454096 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.453995 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:23.482698 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.482674 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:23.485850 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.485835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.489712 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.489688 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-z6qcv\"" Jul 31 14:58:23.489812 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.489742 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 31 14:58:23.503008 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.502982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.503128 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.503039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64pn8\" (UniqueName: \"kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.504504 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.504484 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:23.603451 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.603427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.603618 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.603470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64pn8\" (UniqueName: \"kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.603788 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.603757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.612697 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.612676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64pn8\" (UniqueName: \"kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8\") pod \"seaweedfs-tls-custom-6644bf5d6c-vnf6l\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.795018 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.794994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:23.924461 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:23.924386 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:23.926825 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:58:23.926796 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dcf5f8_cb35_4fba_83ee_cbad321b2f3b.slice/crio-b037800b9770ce820839701e8b056c887a97ab296c6110f561bf4bd7468c08cf WatchSource:0}: Error finding container b037800b9770ce820839701e8b056c887a97ab296c6110f561bf4bd7468c08cf: Status 404 returned error can't find the container with id b037800b9770ce820839701e8b056c887a97ab296c6110f561bf4bd7468c08cf Jul 31 14:58:24.740402 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:24.740360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" event={"ID":"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b","Type":"ContainerStarted","Data":"b037800b9770ce820839701e8b056c887a97ab296c6110f561bf4bd7468c08cf"} Jul 31 14:58:27.754821 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:27.754787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" event={"ID":"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b","Type":"ContainerStarted","Data":"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469"} Jul 31 14:58:27.770482 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:27.770431 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" podStartSLOduration=1.986102631 podStartE2EDuration="4.77041401s" totalImagesPullingTime="2.784311379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:58:27.770283678 +0000 UTC m=+637.141250508" watchObservedRunningTime="2026-07-31 14:58:27.77041401 +0000 UTC m=+637.141380843" Jul 31 14:58:28.938610 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:28.938576 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:29.763926 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:29.763883 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" podUID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" containerName="seaweedfs-tls-custom" containerID="cri-o://a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469" gracePeriod=30 Jul 31 14:58:30.997508 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:30.997486 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:31.057372 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.057307 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64pn8\" (UniqueName: \"kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8\") pod \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " Jul 31 14:58:31.057372 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.057349 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data\") pod \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\" (UID: \"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b\") " Jul 31 14:58:31.059107 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.059073 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data" (OuterVolumeSpecName: "data") pod "44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" (UID: "44dcf5f8-cb35-4fba-83ee-cbad321b2f3b"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:58:31.059319 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.059296 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8" (OuterVolumeSpecName: "kube-api-access-64pn8") pod "44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" (UID: "44dcf5f8-cb35-4fba-83ee-cbad321b2f3b"). InnerVolumeSpecName "kube-api-access-64pn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:58:31.158885 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.158858 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64pn8\" (UniqueName: \"kubernetes.io/projected/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-kube-api-access-64pn8\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:58:31.158885 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.158879 2564 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b-data\") on node \"ip-10-0-130-97.ec2.internal\" DevicePath \"\"" Jul 31 14:58:31.773491 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.773453 2564 generic.go:356] "Generic (PLEG): container finished" podID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" containerID="a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469" exitCode=0 Jul 31 14:58:31.773659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.773504 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" Jul 31 14:58:31.773659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.773522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" event={"ID":"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b","Type":"ContainerDied","Data":"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469"} Jul 31 14:58:31.773659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.773571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l" event={"ID":"44dcf5f8-cb35-4fba-83ee-cbad321b2f3b","Type":"ContainerDied","Data":"b037800b9770ce820839701e8b056c887a97ab296c6110f561bf4bd7468c08cf"} Jul 31 14:58:31.773659 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.773597 2564 scope.go:117] "RemoveContainer" containerID="a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469" Jul 31 14:58:31.782884 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.782859 2564 scope.go:117] "RemoveContainer" containerID="a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469" Jul 31 14:58:31.783137 ip-10-0-130-97 kubenswrapper[2564]: E0731 14:58:31.783117 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469\": container with ID starting with a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469 not found: ID does not exist" containerID="a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469" Jul 31 14:58:31.783196 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.783146 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469"} err="failed to get container status \"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469\": rpc error: code = NotFound desc = could not find container \"a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469\": container with ID starting with a646d726e087801f0c98a7b0e9b753854c2c9d2fef2d3291a86a8acada5d1469 not found: ID does not exist" Jul 31 14:58:31.790439 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.790417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:31.795036 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:31.795017 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-vnf6l"] Jul 31 14:58:33.104159 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:33.104129 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" path="/var/lib/kubelet/pods/44dcf5f8-cb35-4fba-83ee-cbad321b2f3b/volumes" Jul 31 14:58:45.361206 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.361170 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn"] Jul 31 14:58:45.361671 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.361488 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" containerName="seaweedfs-tls-custom" Jul 31 14:58:45.361671 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.361499 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" containerName="seaweedfs-tls-custom" Jul 31 14:58:45.361671 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.361567 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dcf5f8-cb35-4fba-83ee-cbad321b2f3b" containerName="seaweedfs-tls-custom" Jul 31 14:58:45.364339 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.364324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.366579 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.366550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 31 14:58:45.366711 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.366596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 31 14:58:45.366711 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.366615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-z6qcv\"" Jul 31 14:58:45.374070 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.374039 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn"] Jul 31 14:58:45.385124 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.385099 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:45.469917 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.469888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmrkd\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-kube-api-access-nmrkd\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.470089 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.469924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.470089 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.469961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-data\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.477601 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.477571 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:45.570933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.570902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmrkd\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-kube-api-access-nmrkd\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.570933 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.570938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.571105 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.570981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-data\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.571376 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.571356 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-data\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.573330 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.573314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.583256 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.583229 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmrkd\" (UniqueName: \"kubernetes.io/projected/e16fa19d-ca1c-4af5-98e3-fabdba22ad16-kube-api-access-nmrkd\") pod \"seaweedfs-tls-serving-67b7477c6d-dbjxn\" (UID: \"e16fa19d-ca1c-4af5-98e3-fabdba22ad16\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.673703 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.673648 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" Jul 31 14:58:45.802603 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.802579 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn"] Jul 31 14:58:45.804524 ip-10-0-130-97 kubenswrapper[2564]: W0731 14:58:45.804496 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16fa19d_ca1c_4af5_98e3_fabdba22ad16.slice/crio-0d9cda9923024c1997192567140a2f44850936b03426014d0eab4d7c51cd8a2a WatchSource:0}: Error finding container 0d9cda9923024c1997192567140a2f44850936b03426014d0eab4d7c51cd8a2a: Status 404 returned error can't find the container with id 0d9cda9923024c1997192567140a2f44850936b03426014d0eab4d7c51cd8a2a Jul 31 14:58:45.805755 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.805741 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:58:45.834503 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:45.834481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" event={"ID":"e16fa19d-ca1c-4af5-98e3-fabdba22ad16","Type":"ContainerStarted","Data":"0d9cda9923024c1997192567140a2f44850936b03426014d0eab4d7c51cd8a2a"} Jul 31 14:58:46.840514 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:46.840485 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" event={"ID":"e16fa19d-ca1c-4af5-98e3-fabdba22ad16","Type":"ContainerStarted","Data":"480d9a3973e61d3960bfe26fb560cb5374c34f7c45c401b614e0f0281fc1d53d"} Jul 31 14:58:47.129088 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:47.129010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:47.231477 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:47.231448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:59.212285 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:59.212232 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:58:59.284862 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:58:59.284818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:10.715206 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:59:10.715166 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 14:59:11.937768 ip-10-0-130-97 kubenswrapper[2564]: I0731 14:59:11.937724 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:25.005577 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:00:25.005484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:55.913326 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:00:55.913283 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:56.055859 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:00:56.055818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:56.223491 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:00:56.223396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:00:56.313903 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:00:56.313866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:01.068978 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:01:01.068940 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:01:01.510001 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:01:01.509970 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:26.012206 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:26.012168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:31.094616 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:31.094573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:31.181121 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:31.181082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:31.363984 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:31.363900 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:46.269308 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:46.269265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:46.859204 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:46.859167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:51.136110 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:51.136073 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:02:51.451879 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:02:51.451788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:04.379494 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:04.379449 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:04.478277 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:04.478247 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:08.067210 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:08.067171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:08.124722 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:08.124685 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:09.548403 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:09.548373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:09.708816 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:09.708763 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:19.625785 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:19.625751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:24.772261 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:24.772218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:03:24.939720 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:03:24.939676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:04:26.392966 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:04:26.392884 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:04:28.040921 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:04:28.040887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:04:37.652110 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:04:37.652073 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:05:18.636342 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:05:18.636308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:05:20.048099 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:05:20.048058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:05:20.460369 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:05:20.460270 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:07.288921 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:06:07.288880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:50.225622 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:06:50.225583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:55.313867 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:06:55.313820 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:06:55.685745 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:06:55.685664 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:12.948992 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:07:12.948945 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:18.051076 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:07:18.051042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:07:18.388422 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:07:18.388335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:08:25.479690 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:08:25.479635 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:08:30.601805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:08:30.601750 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:08:30.918559 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:08:30.918442 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:08:56.625243 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:08:56.625205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:04.471142 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:09:04.471097 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:09.667623 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:09:09.667578 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:09:09.750653 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:09:09.750615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:01.595724 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:10:01.595691 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:06.736994 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:10:06.736948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:10:06.805083 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:10:06.805046 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:11.862756 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:11.862714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:26.806768 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:26.806735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:31.909056 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:31.909025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:32.124115 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:32.124081 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:36.819515 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:36.819476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:41.950854 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:41.950818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:11:42.222677 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:11:42.222598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:12.141525 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:12.141487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:17.248557 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:17.248522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:17.504151 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:17.504062 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:19.291684 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:19.291651 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:24.409730 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:24.409667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:24.635465 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:24.635436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:43.910309 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:43.910265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:47.594213 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:47.594180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:13:47.847847 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:13:47.847743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:30.034498 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:30.034463 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:35.157377 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:35.157340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:35.366267 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:35.366227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:54.565713 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:54.565598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:56.675395 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:56.675356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:14:59.689038 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:14:59.688999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:15:00.341009 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:15:00.340968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:16:59.543396 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:16:59.543348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:20.862719 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:20.862683 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:25.895865 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:25.895830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:25.978815 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:25.978767 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:26.056865 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:26.056830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:26.203196 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:26.203097 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:17:59.915649 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:17:59.915615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:18:04.984213 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:18:04.984166 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:18:05.333185 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:18:05.333143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:18:36.928808 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:18:36.928753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:18:42.020940 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:18:42.020881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:18:42.227308 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:18:42.227278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:06.017436 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:06.017402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:06.088577 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:06.088542 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:11.157122 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:11.157082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:11.814744 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:11.814700 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:11.881854 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:11.881822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:42.137153 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:42.137114 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:47.330723 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:47.330681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:19:47.797058 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:19:47.797027 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:18.920026 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:20:18.919992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:20:41.255261 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:20:41.255222 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:17.481203 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:21:17.481124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:22.598372 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:21:22.598339 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:21:22.866124 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:21:22.866044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:21.496515 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:21.496470 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:26.631411 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:26.631374 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:26.727833 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:26.727801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:26.893834 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:26.893727 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:27.812191 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:27.812159 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:52.826119 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:52.826069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:52.959360 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:52.959326 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:57.948324 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:57.948295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:22:58.140522 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:22:58.140486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:23:39.627466 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:23:39.627435 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:23:44.767372 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:23:44.767282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:23:45.068340 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:23:45.068261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:23:56.675069 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:23:56.675037 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:24:26.033407 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:24:26.033377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:24:31.141767 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:24:31.141734 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:24:31.213518 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:24:31.213487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:32.780393 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:32.780361 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:47.074395 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:47.074363 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:51.935164 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:51.935128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:52.012867 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:52.012830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:52.075868 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:52.075839 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:52.266451 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:52.266418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:25:52.724556 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:25:52.724476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:26:45.335259 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:26:45.335172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:26:50.468284 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:26:50.468248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:26:50.715653 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:26:50.715618 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:27:49.466209 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:27:49.466170 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:07.062212 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:07.062177 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:07.162125 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:07.162071 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:17.313826 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:17.313697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:17.894957 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:17.894922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:30.610973 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:30.610939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:35.720822 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:35.720791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:28:35.912097 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:28:35.912068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:25.856571 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:25.856509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:31.022793 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:31.022747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:31.297844 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:31.297746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:36.471140 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:36.471094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:48.050161 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:48.050077 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:53.219293 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:53.219254 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:29:53.318130 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:29:53.318095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:30:21.180804 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:30:21.180736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:30:26.247882 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:30:26.247837 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:30:26.548622 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:30:26.548586 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:23.639714 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:23.639684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:28.778226 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:28.778180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:29.068830 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:29.068745 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:46.421077 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:46.421041 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:51.508906 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:51.508868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:31:51.589221 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:31:51.589188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:12.263476 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:12.263443 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:18.962337 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:18.962274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:24.008388 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:24.008350 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:24.112969 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:24.112935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:51.638602 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:51.638520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:55.490579 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:55.490549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:56.773694 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:56.773656 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:56.926029 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:56.925996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:59.181648 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:59.181621 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:32:59.670746 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:32:59.670710 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:33:49.304210 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:33:49.304173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:33:54.424452 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:33:54.424418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:33:54.778388 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:33:54.778356 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:33:59.083202 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:33:59.083163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:34:36.889511 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:34:36.889479 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:34:42.211098 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:34:42.211063 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:34:42.311910 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:34:42.311879 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:35:14.567249 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:35:14.567209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:35:19.647154 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:35:19.647121 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:35:20.132463 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:35:20.132428 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:35:50.450878 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:35:50.450790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:12.162803 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:12.162743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:12.281833 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:12.281753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:12.408467 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:12.408431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:31.371535 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:31.371502 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:36.475274 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:36.475230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:36:37.148102 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:36:37.148065 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:38.177531 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:38.177488 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:42.358184 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:42.358146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:43.286166 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:43.286133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:43.456577 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:43.456522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:43.632713 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:43.632633 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:43.732602 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:43.732565 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:53.462264 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:53.462228 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:54.536793 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:54.536736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:37:56.256652 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:37:56.256617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:45.278696 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:38:45.278613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:50.406195 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:38:50.406156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:38:50.505988 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:38:50.505934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:14.744877 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:14.744836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:15.818065 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:15.818027 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:16.008130 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:16.008090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:25.787691 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:25.787651 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:26.916839 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:26.916799 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:39:27.080769 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:39:27.080727 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:31.525626 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:31.525595 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:36.649351 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:36.649314 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:37.148730 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:37.148698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:46.903181 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:46.903134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:47.916347 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:47.916315 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:49.098070 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:49.098039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:40:57.957692 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:40:57.957652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:08.122698 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:08.122615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:12.066942 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:12.066911 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:13.930201 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:13.930168 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:14.030372 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:14.030341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:49.895898 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:49.895861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:50.050789 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:50.050738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:50.152527 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:50.152441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:52.687872 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:52.687834 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cs8rz_866c36f9-752c-45a6-98d4-e0af9ca5ec65/global-pull-secret-syncer/0.log" Jul 31 15:42:52.846349 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:52.846315 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" Jul 31 15:42:52.970056 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:52.969975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-97.ec2.internal_0e504157da6704e201008e686b90b4bd/haproxy/0.log" Jul 31 15:42:55.594636 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:55.594600 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:55.669511 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:55.669476 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:42:57.341189 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.341155 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/alertmanager/0.log" Jul 31 15:42:57.373721 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.373690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/config-reloader/0.log" Jul 31 15:42:57.403590 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.403562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/kube-rbac-proxy-web/0.log" Jul 31 15:42:57.435657 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.435631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/kube-rbac-proxy/0.log" Jul 31 15:42:57.469900 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.469867 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/kube-rbac-proxy-metric/0.log" Jul 31 15:42:57.499417 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.499385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/prom-label-proxy/0.log" Jul 31 15:42:57.531692 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.531666 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_88f12ea9-4d40-4400-a46a-9a1f876aa305/init-config-reloader/0.log" Jul 31 15:42:57.782363 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.782338 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxcb7_c33e9eba-4d7a-4558-85bb-22514b3ff670/node-exporter/0.log" Jul 31 15:42:57.811741 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.811713 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxcb7_c33e9eba-4d7a-4558-85bb-22514b3ff670/kube-rbac-proxy/0.log" Jul 31 15:42:57.843416 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:57.843389 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxcb7_c33e9eba-4d7a-4558-85bb-22514b3ff670/init-textfile/0.log" Jul 31 15:42:58.036279 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.036203 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-sfmsh_055a1e69-4903-4f49-8719-0fd89e1ff53b/kube-rbac-proxy-main/0.log" Jul 31 15:42:58.062683 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.062657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-sfmsh_055a1e69-4903-4f49-8719-0fd89e1ff53b/kube-rbac-proxy-self/0.log" Jul 31 15:42:58.093156 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.093129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-sfmsh_055a1e69-4903-4f49-8719-0fd89e1ff53b/openshift-state-metrics/0.log" Jul 31 15:42:58.344708 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.344631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-tfr9r_d3243405-b6cf-4c3d-b990-51900be6cdd3/prometheus-operator/0.log" Jul 31 15:42:58.387023 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.386998 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-tfr9r_d3243405-b6cf-4c3d-b990-51900be6cdd3/kube-rbac-proxy/0.log" Jul 31 15:42:58.428981 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.428954 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-k4j6v_ae6b3c2c-c6e6-4ac9-9e9f-7b145b449151/prometheus-operator-admission-webhook/0.log" Jul 31 15:42:58.493247 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.493220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd5db5f6-q4pf8_deddcffe-3e59-4031-b7fe-a8b1c0156d03/telemeter-client/0.log" Jul 31 15:42:58.564959 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.564930 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd5db5f6-q4pf8_deddcffe-3e59-4031-b7fe-a8b1c0156d03/reload/0.log" Jul 31 15:42:58.634730 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:42:58.634706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddd5db5f6-q4pf8_deddcffe-3e59-4031-b7fe-a8b1c0156d03/kube-rbac-proxy/0.log" Jul 31 15:43:00.876880 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:00.876844 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7ff89555-62gtk_2a76701e-1562-45a8-a139-06534a3282f4/console/0.log" Jul 31 15:43:01.064694 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.064642 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-dbjxn" podStartSLOduration=2655.802376798 podStartE2EDuration="44m16.064626888s" totalImagesPullingTime="262.25009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:58:46.872691289 +0000 UTC m=+656.243658121" watchObservedRunningTime="2026-07-31 15:43:01.064626888 +0000 UTC m=+3310.435593719" Jul 31 15:43:01.066368 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.066345 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb"] Jul 31 15:43:01.069785 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.069757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.072193 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.072173 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxx9f\"/\"kube-root-ca.crt\"" Jul 31 15:43:01.072390 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.072374 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cxx9f\"/\"default-dockercfg-rzbd9\"" Jul 31 15:43:01.072987 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.072970 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxx9f\"/\"openshift-service-ca.crt\"" Jul 31 15:43:01.086354 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.086320 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb"] Jul 31 15:43:01.226195 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.226103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-lib-modules\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.226195 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.226149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-proc\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.226195 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.226191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fx5h\" (UniqueName: \"kubernetes.io/projected/aa181f1f-188a-4675-b9eb-29f725225d00-kube-api-access-2fx5h\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.226466 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.226228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-podres\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.226466 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.226249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-sys\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327567 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fx5h\" (UniqueName: \"kubernetes.io/projected/aa181f1f-188a-4675-b9eb-29f725225d00-kube-api-access-2fx5h\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-podres\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-sys\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-lib-modules\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-proc\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.327805 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-sys\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.328010 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-proc\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.328010 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327817 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-podres\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.328010 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.327869 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa181f1f-188a-4675-b9eb-29f725225d00-lib-modules\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.336920 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.336885 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fx5h\" (UniqueName: \"kubernetes.io/projected/aa181f1f-188a-4675-b9eb-29f725225d00-kube-api-access-2fx5h\") pod \"perf-node-gather-daemonset-dp7zb\" (UID: \"aa181f1f-188a-4675-b9eb-29f725225d00\") " pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.379421 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.379383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:01.516738 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:01.516705 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb"] Jul 31 15:43:01.519316 ip-10-0-130-97 kubenswrapper[2564]: W0731 15:43:01.519285 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa181f1f_188a_4675_b9eb_29f725225d00.slice/crio-1000d8759fdc847803356cdd68d78d9515d431280a4ebdd12b27549dd1ad53c0 WatchSource:0}: Error finding container 1000d8759fdc847803356cdd68d78d9515d431280a4ebdd12b27549dd1ad53c0: Status 404 returned error can't find the container with id 1000d8759fdc847803356cdd68d78d9515d431280a4ebdd12b27549dd1ad53c0 Jul 31 15:43:02.203858 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.203818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" event={"ID":"aa181f1f-188a-4675-b9eb-29f725225d00","Type":"ContainerStarted","Data":"07182d85b22e9543ce2cc20f267a8ff9f3266fbae1dab4f01982137703b8a7cc"} Jul 31 15:43:02.204272 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.203881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" event={"ID":"aa181f1f-188a-4675-b9eb-29f725225d00","Type":"ContainerStarted","Data":"1000d8759fdc847803356cdd68d78d9515d431280a4ebdd12b27549dd1ad53c0"} Jul 31 15:43:02.204272 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.203996 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:02.221406 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.221356 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" podStartSLOduration=1.221340159 podStartE2EDuration="1.221340159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 15:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:43:02.220343954 +0000 UTC m=+3311.591310784" watchObservedRunningTime="2026-07-31 15:43:02.221340159 +0000 UTC m=+3311.592306990" Jul 31 15:43:02.533719 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.533685 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6hsm_ea7d0a8d-c93a-4423-8cbd-87b1ba866241/dns/0.log" Jul 31 15:43:02.558012 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.557971 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6hsm_ea7d0a8d-c93a-4423-8cbd-87b1ba866241/kube-rbac-proxy/0.log" Jul 31 15:43:02.609572 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:02.609544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vxq87_50eefe5b-80d0-4590-be39-a7f07ed822d8/dns-node-resolver/0.log" Jul 31 15:43:03.163500 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:03.163468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v8j88_a079510b-d28d-4970-b93c-3460728b05d4/node-ca/0.log" Jul 31 15:43:03.897508 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:03.897474 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77f9449df4-bp57p_52236573-b133-40e2-bc8d-43e689688398/router/0.log" Jul 31 15:43:04.275013 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:04.274980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zjt7z_52bcc543-a23c-4a00-be94-d971978c57c4/serve-healthcheck-canary/0.log" Jul 31 15:43:04.800307 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:04.800279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrnb5_cad99efb-c8b1-422b-ac5e-c13d5490008c/kube-rbac-proxy/0.log" Jul 31 15:43:04.821016 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:04.820986 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrnb5_cad99efb-c8b1-422b-ac5e-c13d5490008c/exporter/0.log" Jul 31 15:43:04.844307 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:04.844284 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrnb5_cad99efb-c8b1-422b-ac5e-c13d5490008c/extractor/0.log" Jul 31 15:43:07.406439 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:07.406408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-6rt4r_ae8bc0f3-99ca-44cf-bb80-bcbe09071323/manager/0.log" Jul 31 15:43:07.427909 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:07.427883 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-gxx97_9444b980-328c-41f3-af76-6d12bcd96780/server/0.log" Jul 31 15:43:07.696186 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:07.696102 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-8588677cfb-v4tgj_dcdf2e7c-af58-4b7d-8a62-bf40ad56fd1c/manager/0.log" Jul 31 15:43:07.954330 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:07.954248 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-dbjxn_e16fa19d-ca1c-4af5-98e3-fabdba22ad16/seaweedfs-tls-serving/0.log" Jul 31 15:43:08.218235 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:08.218162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cxx9f/perf-node-gather-daemonset-dp7zb" Jul 31 15:43:11.061313 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:11.061277 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2pb6w_d903400e-d3af-4f81-af5d-d9c4b2b8ddba/konnectivity-agent/0.log" limit=1024 Jul 31 15:43:13.413015 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.412682 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/kube-multus-additional-cni-plugins/0.log" Jul 31 15:43:13.437646 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.437619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/egress-router-binary-copy/0.log" Jul 31 15:43:13.462367 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.462339 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/cni-plugins/0.log" Jul 31 15:43:13.485917 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.485894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/bond-cni-plugin/0.log" Jul 31 15:43:13.514387 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.514357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/routeoverride-cni/0.log" Jul 31 15:43:13.536185 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.536159 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/whereabouts-cni-bincopy/0.log" Jul 31 15:43:13.558784 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.558754 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47hhq_f6fd891a-dc19-4cfa-99fd-9785861e0865/whereabouts-cni/0.log" Jul 31 15:43:13.938420 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:13.938391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bkt4s_a6814e71-b973-443f-b87b-975f85d20e3c/kube-multus/0.log" Jul 31 15:43:14.086423 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:14.086394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zt6tc_70172f5d-eab0-4b97-8058-5361e0ea20c1/network-metrics-daemon/0.log" Jul 31 15:43:14.108047 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:14.108016 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zt6tc_70172f5d-eab0-4b97-8058-5361e0ea20c1/kube-rbac-proxy/0.log" Jul 31 15:43:15.324094 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.324064 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/ovn-controller/0.log" Jul 31 15:43:15.343179 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.343152 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/ovn-acl-logging/0.log" Jul 31 15:43:15.367274 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.367250 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/kube-rbac-proxy-node/0.log" Jul 31 15:43:15.390942 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.390902 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 15:43:15.412686 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.412650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/northd/0.log" Jul 31 15:43:15.433458 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.433429 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/nbdb/0.log" Jul 31 15:43:15.459554 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.459510 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/sbdb/0.log" Jul 31 15:43:15.505389 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:15.505358 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wp76d_d12c80ac-a1e7-47e0-ac70-147bbe409805/ovnkube-controller/0.log" Jul 31 15:43:16.603071 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:16.603038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kgnw9_e9e09a90-8808-441e-a66b-494c8d5352a5/network-check-target-container/0.log" Jul 31 15:43:17.589883 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:17.589856 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jj9lw_81d042ac-9f19-4c6e-b011-b6b6abe26aa4/iptables-alerter/0.log" Jul 31 15:43:18.257270 ip-10-0-130-97 kubenswrapper[2564]: I0731 15:43:18.257245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-b494h_f865f6e2-2201-457e-b4f9-2978235da0b7/tuned/0.log"