Jul 07 14:54:58.425104 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:54:58.425120 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:54:58.425130 ip-10-0-138-241 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:54:58.425402 ip-10-0-138-241 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:55:07.912151 ip-10-0-138-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 07 14:55:07.912165 ip-10-0-138-241 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 67025468a11349a298f8534118333092 -- Jul 07 14:56:54.974726 ip-10-0-138-241 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.353283 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356736 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356747 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356752 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356756 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356758 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356761 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356764 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.432146 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356769 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.423366 ip-10-0-138-241 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356773 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356776 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356778 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356781 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356783 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356786 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356789 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356791 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356794 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356796 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356799 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356802 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356805 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356807 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356809 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356812 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356814 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356817 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356819 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.434543 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356822 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356824 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356827 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356830 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356832 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356835 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356837 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356840 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356842 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356845 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356847 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356850 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356852 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356855 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356857 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356860 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356862 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356864 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356867 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.435174 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356869 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356872 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356874 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356877 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356880 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356882 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356885 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356887 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356890 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356892 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356894 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356897 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356899 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356902 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356904 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356908 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356911 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356913 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356916 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356919 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.436082 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356921 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356924 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356927 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356929 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356932 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356935 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356937 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356939 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356942 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356944 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356947 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356950 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356952 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356955 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356958 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356961 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356964 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356966 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356968 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.437239 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356972 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356976 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356978 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356981 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356984 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356986 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356989 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356991 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356994 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356997 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.356999 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357003 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357006 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357009 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357705 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357712 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357716 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357719 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357721 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357725 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.438325 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357727 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357730 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357733 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357735 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357738 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357742 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357745 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357749 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357751 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357756 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357758 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357761 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357763 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357766 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357768 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357771 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357773 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357776 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357779 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357781 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.439417 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357784 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357787 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357789 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357792 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357794 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357797 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357800 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357802 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357805 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357807 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357809 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357812 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357815 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357817 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357820 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357822 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357825 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357828 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357830 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.535141 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357833 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357836 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357839 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357842 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357844 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357847 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357850 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357852 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357855 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357857 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357860 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357862 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357865 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357867 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357870 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357873 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357875 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357879 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357883 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357886 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.536241 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357888 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357891 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357893 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357896 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357898 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357901 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357904 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357907 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357909 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357912 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357914 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357917 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357921 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357925 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357928 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357932 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357934 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357937 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357940 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357942 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.538354 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357945 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357947 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357950 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357952 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357955 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357957 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357960 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357963 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357966 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357969 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357971 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357974 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357976 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.357979 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358332 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358338 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358342 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358346 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358349 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.538954 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358352 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358355 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358357 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358360 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358363 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358366 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358369 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358371 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358374 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358376 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358379 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358381 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358384 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358387 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358389 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358392 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358394 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358397 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358399 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358402 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.539541 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358405 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358407 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358410 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358412 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358415 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358418 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358420 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358422 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358425 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358427 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358430 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358432 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358451 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358456 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358459 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358462 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358465 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358470 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358473 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358475 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.540067 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358478 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358481 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358483 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358485 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358488 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358490 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358493 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358496 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358498 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358501 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358503 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358506 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358509 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358513 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358516 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358520 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358522 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358525 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358529 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.540551 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358532 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358534 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358537 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358540 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358543 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358545 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358548 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358551 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358553 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358556 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358560 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358562 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358565 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358567 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358570 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358572 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358574 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358577 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358580 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358583 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.541006 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358585 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358588 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358590 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358593 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358597 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358600 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358602 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358605 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358607 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358610 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358613 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358615 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358618 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358620 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.358623 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358691 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358698 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358706 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358713 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358719 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358723 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:56:55.541488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358727 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358733 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358737 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358740 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358743 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358759 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358764 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358768 2558 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358771 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358774 2558 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358777 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358780 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358784 2558 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358787 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358790 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358794 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358798 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358801 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358804 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358807 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358810 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358813 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358816 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358819 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:56:55.541977 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358823 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358826 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358830 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358833 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358836 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358839 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358842 2558 flags.go:64] FLAG: --enable-server="true" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358846 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358850 2558 flags.go:64] FLAG: --event-burst="100" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358858 2558 flags.go:64] FLAG: --event-qps="50" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358861 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358864 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358867 2558 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358871 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358874 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358877 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358880 2558 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358883 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358886 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358889 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358892 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358895 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358898 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358903 2558 flags.go:64] FLAG: --feature-gates="" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358909 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:56:55.542556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358912 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358915 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358918 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358921 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358924 2558 flags.go:64] FLAG: --help="false" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358926 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358930 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358932 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358935 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358938 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358942 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358945 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358948 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358951 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358953 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358957 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358961 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358964 2558 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358967 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358969 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358972 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358975 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358978 2558 flags.go:64] FLAG: --lock-file="" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358981 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:56:55.543164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358984 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358987 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358992 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358995 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.358998 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359001 2558 flags.go:64] FLAG: --logging-format="text" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359005 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359008 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359011 2558 flags.go:64] FLAG: --manifest-url="" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359014 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359018 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359021 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359025 2558 flags.go:64] FLAG: --max-pods="110" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359028 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359030 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359033 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359036 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359039 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359042 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359045 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359051 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359054 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359057 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:56:55.543779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359061 2558 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359066 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359071 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359074 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359078 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359081 2558 flags.go:64] FLAG: --port="10250" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359084 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359086 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2bceef86e962184" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359089 2558 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359092 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359095 2558 flags.go:64] FLAG: --register-node="true" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359098 2558 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359101 2558 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359104 2558 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359107 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359110 2558 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359115 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359118 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359121 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359123 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359126 2558 flags.go:64] FLAG: --runonce="false" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359129 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359132 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359135 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359138 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:56:55.544375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359141 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359144 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359147 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359150 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359153 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359156 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359158 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359161 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359165 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359169 2558 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359171 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359177 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359179 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359182 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359186 2558 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359189 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359191 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359194 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359197 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359200 2558 flags.go:64] FLAG: --v="2" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359204 2558 flags.go:64] FLAG: --version="false" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359208 2558 flags.go:64] FLAG: --vmodule="" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359211 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.359216 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359335 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.562469 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359339 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359342 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359345 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359348 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359351 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359354 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359356 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359359 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359362 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359364 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359366 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359369 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359371 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359374 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359378 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359383 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359386 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359389 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359392 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.563285 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359395 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359398 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359401 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359403 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359406 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359409 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359412 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359414 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359417 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359419 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359422 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359426 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359428 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359431 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359434 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359451 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359454 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359457 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359460 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359463 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.563857 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359466 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359468 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359471 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359473 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359476 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359478 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359481 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359484 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359490 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359494 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359497 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359500 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359503 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359506 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359508 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359511 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359514 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359516 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359519 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.564478 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359521 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359524 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359526 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359529 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359532 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359536 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359540 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359543 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359546 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359549 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359551 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359554 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359557 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359560 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359562 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359565 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359568 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359570 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359573 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359575 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.565053 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359578 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359582 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359584 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359587 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359589 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359592 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359595 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359598 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359600 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359603 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359605 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359607 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359610 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359612 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359615 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359617 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359621 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359623 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359626 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.565696 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.359629 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.360101 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.366882 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.366899 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.366918 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.366925 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368491 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368507 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368511 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368514 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368518 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368521 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368524 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368527 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368530 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.566247 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368532 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368535 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368538 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368540 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368543 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368546 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368549 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368551 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368554 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368558 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368560 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368563 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368566 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368568 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368571 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368574 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368576 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368579 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368581 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368584 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.566691 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368591 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368594 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368596 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368599 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368601 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368604 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368607 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368610 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368612 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368615 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368618 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368620 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368623 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368625 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368628 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368631 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368633 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368636 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368639 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368642 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.567262 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368644 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368653 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368656 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368658 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368661 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368663 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368666 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368668 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368671 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368673 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368676 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368681 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368686 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368689 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368691 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368694 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368696 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368699 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368701 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.567850 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368704 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368706 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368709 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368711 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368716 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368719 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368722 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368725 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368728 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368731 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368735 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368738 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368741 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368745 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368748 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368751 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368754 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368757 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368760 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.568377 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368763 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368765 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368768 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368770 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368773 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368775 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368779 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368782 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368784 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368787 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368789 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368792 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.368797 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368921 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368925 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:55.568921 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368928 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368931 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368934 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368937 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368940 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368943 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368945 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368948 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368955 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368957 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368960 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368963 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368965 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368968 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368971 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368973 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368976 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368978 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368981 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368983 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:55.569429 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368986 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368988 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368991 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368993 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368997 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.368999 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369002 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369004 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369007 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369010 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369013 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369015 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369018 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369021 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369025 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369028 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369030 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369033 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369036 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:55.570871 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369039 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369045 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369048 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369050 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369053 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369055 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369058 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369060 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369063 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369066 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369068 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369070 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369073 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369075 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369078 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369080 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369083 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369087 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369089 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:55.571751 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369092 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369094 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369097 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369099 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369102 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369104 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369107 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369109 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369112 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369114 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369117 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369119 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369122 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369124 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369128 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369130 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369133 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369136 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369138 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369142 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:55.572359 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369146 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369149 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369152 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369155 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369157 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369160 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369163 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369165 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369168 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369170 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369174 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369176 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369179 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369181 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369183 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369186 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369188 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369191 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:55.572988 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:55.369193 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.369198 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.369311 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.373423 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.374588 2558 server.go:1019] "Starting client certificate rotation" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.374683 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.374714 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.377380 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.378576 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.387902 2558 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.391414 2558 log.go:25] "Validated CRI v1 image API" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.392252 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:56:55.573559 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.395627 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c712cbab-0009-4681-9808-260a8b709782:/dev/nvme0n1p3 c89388f0-f932-403f-b6dc-99be750dfebd:/dev/nvme0n1p4] Jul 07 14:56:55.573929 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.395648 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.402081 2558 manager.go:216] Machine: {Timestamp:2026-07-07 14:56:55.399341838 +0000 UTC m=+0.308584206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092260 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e99f8189fceac1c86286ab1ac4bc SystemUUID:ec25e99f-8189-fcea-c1c8-6286ab1ac4bc BootID:67025468-a113-49a2-98f8-534118333092 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:5d:54:cf:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:5d:54:cf:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:bc:ea:38:5b:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.402186 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.402270 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.403476 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.405204 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.405230 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:56:55.573967 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.406070 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.406080 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.406088 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.406754 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.407919 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410573 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410696 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410726 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410738 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410752 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410767 2558 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.410777 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.412248 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.412278 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.415413 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.417359 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.417387 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418383 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418398 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418404 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418410 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418421 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418426 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418450 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418458 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418466 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418471 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418484 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.418489 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.419172 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.419178 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.422475 2558 server.go:1268] "Started kubelet" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.422559 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.422563 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.422644 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.424410 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.424859 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.428934 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.428941 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:56:55.574216 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.429079 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.429699 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.428912 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-241.ec2.internal.18c009c9f3d2347f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-241.ec2.internal,UID:ip-10-0-138-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-241.ec2.internal,},FirstTimestamp:2026-07-07 14:56:55.422432383 +0000 UTC m=+0.331674751,LastTimestamp:2026-07-07 14:56:55.422432383 +0000 UTC m=+0.331674751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-241.ec2.internal,}" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.433256 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctnwv" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435175 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435186 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.435377 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435875 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435890 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435883 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435971 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.435982 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436082 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436095 2558 factory.go:55] Registering systemd factory Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436104 2558 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436335 2558 factory.go:153] Registering CRI-O factory Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436348 2558 factory.go:223] Registration of the crio container factory successfully Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436372 2558 factory.go:103] Registering Raw factory Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436386 2558 manager.go:1196] Started watching for new ooms in manager Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.436868 2558 manager.go:349] Starting recovery of all containers Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.438756 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.438873 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.441126 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctnwv" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.450435 2558 manager.go:354] Recovery completed Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.456003 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.459708 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.459740 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.459753 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.460349 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.460359 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.460363 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.460375 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:56:55.575309 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.461191 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.461213 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.461223 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.463988 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-241.ec2.internal.18c009c9f60b3797 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-241.ec2.internal,UID:ip-10-0-138-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-241.ec2.internal,},FirstTimestamp:2026-07-07 14:56:55.459723159 +0000 UTC m=+0.368965528,LastTimestamp:2026-07-07 14:56:55.459723159 +0000 UTC m=+0.368965528,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-241.ec2.internal,}" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.464367 2558 policy_none.go:49] "None policy: Start" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.464380 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.464392 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.465397 2558 policy_none.go:47] "Start" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.497549 2558 manager.go:337] "Starting Device Plugin manager" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.497597 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.497607 2558 server.go:87] "Starting device plugin registration server" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.497876 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.497900 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.498071 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.498275 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.498285 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.498728 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.498788 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.567725 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.568955 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.568994 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.569017 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.569064 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:56:55.576240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.572383 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:55.599261 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.599197 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.600239 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.600223 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.600304 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.600255 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.600304 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.600283 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.600384 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.600311 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.612344 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.612326 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.612397 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.612350 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-241.ec2.internal\": node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.631147 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.631126 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.669248 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.669202 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal"] Jul 07 14:56:55.669323 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.669295 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.670203 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.670184 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.670256 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.670221 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.670256 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.670237 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.672078 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672065 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.672209 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672194 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.672245 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672228 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.672862 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672841 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.672862 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672861 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.673006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672874 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.673006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672885 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.673006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672896 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.673006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.672886 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.674114 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.674095 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.674163 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.674134 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:55.674860 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.674844 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:55.674941 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.674870 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:55.674941 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.674888 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:55.710344 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.710323 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.715233 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.715212 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-241.ec2.internal\" not found" node="ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.731772 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.731754 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.738628 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.738609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.738709 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.738638 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.738709 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.738658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce1e171c152e4994dbda02fc177e4774-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"ce1e171c152e4994dbda02fc177e4774\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.831856 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.831827 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:55.839676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.839741 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839706 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.839778 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce1e171c152e4994dbda02fc177e4774-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"ce1e171c152e4994dbda02fc177e4774\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.839815 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.839815 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839809 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/845a752d1238c1c0745a1068b7055128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal\" (UID: \"845a752d1238c1c0745a1068b7055128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.839873 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:55.839843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce1e171c152e4994dbda02fc177e4774-config\") pod \"kube-apiserver-proxy-ip-10-0-138-241.ec2.internal\" (UID: \"ce1e171c152e4994dbda02fc177e4774\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:55.933123 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:55.933021 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.019139 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.019097 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:56.019139 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.019132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:56.033509 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.033487 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.137049 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.137005 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.237815 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.237747 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.269108 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.269078 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:56.305807 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.305778 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:56.338892 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.338865 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.375822 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.375796 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:56:56.375993 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.375970 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:56:56.376055 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.375971 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:56:56.376055 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.375984 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:56:56.439718 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.439691 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.443307 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.443265 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:51:55 +0000 UTC" deadline="2027-12-27 17:44:16.260714402 +0000 UTC" Jul 07 14:56:56.443307 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.443306 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12914h47m19.81741099s" Jul 07 14:56:56.540284 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.540254 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.633425 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:56.633375 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1e171c152e4994dbda02fc177e4774.slice/crio-b899f3a80099a964aab9674cb1c977ff0a6974def323395bacfc15ea7926ea83 WatchSource:0}: Error finding container b899f3a80099a964aab9674cb1c977ff0a6974def323395bacfc15ea7926ea83: Status 404 returned error can't find the container with id b899f3a80099a964aab9674cb1c977ff0a6974def323395bacfc15ea7926ea83 Jul 07 14:56:56.633794 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:56.633773 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845a752d1238c1c0745a1068b7055128.slice/crio-ea999d8975da5c34f7820cfa94a34af97c1ad2a69aef213eef619b4db9ade7b5 WatchSource:0}: Error finding container ea999d8975da5c34f7820cfa94a34af97c1ad2a69aef213eef619b4db9ade7b5: Status 404 returned error can't find the container with id ea999d8975da5c34f7820cfa94a34af97c1ad2a69aef213eef619b4db9ade7b5 Jul 07 14:56:56.637690 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.637673 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:56:56.641461 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.641430 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.742526 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.742475 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.843645 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:56.843586 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-241.ec2.internal\" not found" Jul 07 14:56:56.942583 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:56.942551 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:57.038140 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.038103 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" Jul 07 14:56:57.052263 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.052240 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:56:57.053199 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.053185 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" Jul 07 14:56:57.065390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.065373 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:56:57.396221 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.396124 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:57.413088 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.413043 2558 apiserver.go:52] "Watching apiserver" Jul 07 14:56:57.419592 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.419564 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:56:57.420214 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.420183 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-7q2cf","openshift-ovn-kubernetes/ovnkube-node-wfsf9","kube-system/global-pull-secret-syncer-vjmx9","kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs","openshift-dns/node-resolver-tws2n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal","openshift-multus/network-metrics-daemon-br4bh","openshift-network-diagnostics/network-check-target-ljwlj","kube-system/konnectivity-agent-2d59v","openshift-cluster-node-tuning-operator/tuned-hzv5p","openshift-image-registry/node-ca-ft6mk","openshift-multus/multus-additional-cni-plugins-wftqr","openshift-multus/multus-cq4sp"] Jul 07 14:56:57.422131 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.422108 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.423985 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.423962 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.424219 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.424198 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:56:57.425103 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425085 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:56:57.425319 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425300 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.425381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425324 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.425583 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425564 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:56:57.425669 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425603 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hlck\"" Jul 07 14:56:57.425861 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.425845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.425941 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.425913 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:56:57.426052 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.426033 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p4vxc\"" Jul 07 14:56:57.426288 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.426273 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.426551 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.426528 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:56:57.426635 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.426589 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:56:57.428287 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.428265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.429398 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.429304 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.431298 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.431332 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.432902 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.433315 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.433472 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.434227 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-66psz\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.434238 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fsx5c\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.434544 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.434880 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.435424 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.437058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.435457 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:56:57.438966 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.438244 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:56:57.440086 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.440063 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.440733 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.440348 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:56:57.440733 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.440719 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vt9mh\"" Jul 07 14:56:57.441048 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.441026 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.444877 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.444857 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.445854 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.445832 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.445959 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.445903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:56:57.447285 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.447268 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:56:57.447663 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.447511 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t6jjm\"" Jul 07 14:56:57.448026 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.448014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:57.448587 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.448159 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:56:57.449028 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-systemd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.449140 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-ovn\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-host-slash\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-kubelet\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-multus-certs\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-netns\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-registration-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-kubelet-config\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-iptables-alerter-script\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-config\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cni-binary-copy\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx544\" (UniqueName: \"kubernetes.io/projected/be305396-8a73-4d25-a243-e2550bb52c52-kube-api-access-vx544\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-binary-copy\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.449724 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2fa145d-725e-4243-b25e-0d4df112768e-tmp-dir\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-env-overrides\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cnibin\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449637 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-socket-dir-parent\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-multus\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-etc-kubernetes\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-os-release\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv99m\" (UniqueName: \"kubernetes.io/projected/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-kube-api-access-pv99m\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gklsg\" (UniqueName: \"kubernetes.io/projected/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-kube-api-access-gklsg\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2fa145d-725e-4243-b25e-0d4df112768e-hosts-file\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.449980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cnibin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450310 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-system-cni-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-netd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhsxn\" (UniqueName: \"kubernetes.io/projected/3f85b2e8-9b22-455a-a205-81c84a8a7b68-kube-api-access-nhsxn\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-bin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-systemd-units\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-log-socket\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-bin\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-script-lib\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450233 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-device-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-hostroot\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-kubelet\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-node-log\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450479 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.450814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-var-lib-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-etc-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-os-release\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-conf-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-sys-fs\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-socket-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdhd\" (UniqueName: \"kubernetes.io/projected/d2fa145d-725e-4243-b25e-0d4df112768e-kube-api-access-mzdhd\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-system-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-netns\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-slash\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4ccp\" (UniqueName: \"kubernetes.io/projected/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-kube-api-access-b4ccp\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.450994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.451390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-dbus\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451067 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-k8s-cni-cncf-io\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-daemon-config\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zjjw9\"" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451471 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.452040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.451685 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:56:57.452455 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.452097 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:56:57.452455 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.452225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.454536 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.454337 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.455203 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.454765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6dnp4\"" Jul 07 14:56:57.455203 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.454897 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:56:57.455203 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.455015 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.455203 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.455154 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zqzrl\"" Jul 07 14:56:57.455488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.455235 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:56:57.455488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.455256 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:56:57.499719 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.499698 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pmmhs" Jul 07 14:56:57.515514 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.515488 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pmmhs" Jul 07 14:56:57.537483 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.537458 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:56:57.552427 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.552427 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-dbus\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.552664 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-dbus\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.552664 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.552924 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553004 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553004 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.552983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553089 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.553089 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-k8s-cni-cncf-io\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553089 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553057 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-daemon-config\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553089 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-systemd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-ovn\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553139 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-ovn\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-host-slash\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-systemd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-k8s-cni-cncf-io\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-kubelet\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553201 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-host-slash\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-kubelet\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-multus-certs\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-netns\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553272 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-registration-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-multus-certs\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-kubelet-config\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-netns\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-iptables-alerter-script\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-registration-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553344 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68361114-6254-43a5-a56c-3d5a5335dd8c-kubelet-config\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553374 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysconfig\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-config\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-conf\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cni-binary-copy\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx544\" (UniqueName: \"kubernetes.io/projected/be305396-8a73-4d25-a243-e2550bb52c52-kube-api-access-vx544\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-binary-copy\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.553823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2fa145d-725e-4243-b25e-0d4df112768e-tmp-dir\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553621 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-serviceca\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-env-overrides\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cnibin\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-modprobe-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-daemon-config\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553791 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-host\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-socket-dir-parent\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553834 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-multus\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-iptables-alerter-script\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.554429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-etc-kubernetes\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-os-release\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-multus\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.553985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv99m\" (UniqueName: \"kubernetes.io/projected/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-kube-api-access-pv99m\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cnibin\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-config\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cni-binary-copy\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554049 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-systemd\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gklsg\" (UniqueName: \"kubernetes.io/projected/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-kube-api-access-gklsg\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-socket-dir-parent\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2fa145d-725e-4243-b25e-0d4df112768e-hosts-file\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-os-release\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554179 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-kubernetes\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-lib-modules\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-etc-kubernetes\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-env-overrides\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cnibin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-system-cni-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-netd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554333 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2fa145d-725e-4243-b25e-0d4df112768e-tmp-dir\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-cnibin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhsxn\" (UniqueName: \"kubernetes.io/projected/3f85b2e8-9b22-455a-a205-81c84a8a7b68-kube-api-access-nhsxn\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-bin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-systemd-units\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-binary-copy\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2fa145d-725e-4243-b25e-0d4df112768e-hosts-file\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554459 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-var-lib-cni-bin\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.555718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-netd\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-systemd-units\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-log-socket\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f85b2e8-9b22-455a-a205-81c84a8a7b68-system-cni-dir\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-bin\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-log-socket\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.554539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-cni-bin\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-var-lib-kubelet\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-tmp\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-script-lib\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-device-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997sl\" (UniqueName: \"kubernetes.io/projected/ae1f681f-2387-45ec-8897-a2d785895797-kube-api-access-997sl\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.556381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-sys\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-tuned\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-host\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-hostroot\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555337 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-kubelet\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-node-log\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555387 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-device-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-var-lib-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-etc-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-os-release\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-var-lib-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-conf-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.555521 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555526 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-hostroot\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.557972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555537 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-sys-fs\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.555573 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:56:58.05555804 +0000 UTC m=+2.964800414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555647 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-node-log\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-kubelet\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-etc-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpztj\" (UniqueName: \"kubernetes.io/projected/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-kube-api-access-jpztj\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-os-release\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555876 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-sys-fs\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-socket-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-multus-conf-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.555998 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovnkube-script-lib\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.558820 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f85b2e8-9b22-455a-a205-81c84a8a7b68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-etc-selinux\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdhd\" (UniqueName: \"kubernetes.io/projected/d2fa145d-725e-4243-b25e-0d4df112768e-kube-api-access-mzdhd\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-system-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be305396-8a73-4d25-a243-e2550bb52c52-socket-dir\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-netns\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556148 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-system-cni-dir\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-host-run-netns\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f466264-6a26-4389-a552-2e14f7f93464-agent-certs\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f466264-6a26-4389-a552-2e14f7f93464-konnectivity-ca\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-run\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mkdn\" (UniqueName: \"kubernetes.io/projected/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-kube-api-access-4mkdn\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-slash\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4ccp\" (UniqueName: \"kubernetes.io/projected/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-kube-api-access-b4ccp\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.559565 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.556296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-run-openvswitch\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.560406 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.557097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-host-slash\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.560406 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.557200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.564488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.564406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gklsg\" (UniqueName: \"kubernetes.io/projected/285c5ba3-62c8-4edb-940d-5ae9f9e9150e-kube-api-access-gklsg\") pod \"multus-cq4sp\" (UID: \"285c5ba3-62c8-4edb-940d-5ae9f9e9150e\") " pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.564488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.564406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv99m\" (UniqueName: \"kubernetes.io/projected/465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7-kube-api-access-pv99m\") pod \"iptables-alerter-7q2cf\" (UID: \"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7\") " pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.564488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.564410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx544\" (UniqueName: \"kubernetes.io/projected/be305396-8a73-4d25-a243-e2550bb52c52-kube-api-access-vx544\") pod \"aws-ebs-csi-driver-node-ll5qs\" (UID: \"be305396-8a73-4d25-a243-e2550bb52c52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.565625 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.565316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdhd\" (UniqueName: \"kubernetes.io/projected/d2fa145d-725e-4243-b25e-0d4df112768e-kube-api-access-mzdhd\") pod \"node-resolver-tws2n\" (UID: \"d2fa145d-725e-4243-b25e-0d4df112768e\") " pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.565870 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.565853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4ccp\" (UniqueName: \"kubernetes.io/projected/9e2bfc63-8331-46a3-90d4-dba7d5da26ad-kube-api-access-b4ccp\") pod \"ovnkube-node-wfsf9\" (UID: \"9e2bfc63-8331-46a3-90d4-dba7d5da26ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.565943 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.565884 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhsxn\" (UniqueName: \"kubernetes.io/projected/3f85b2e8-9b22-455a-a205-81c84a8a7b68-kube-api-access-nhsxn\") pod \"multus-additional-cni-plugins-wftqr\" (UID: \"3f85b2e8-9b22-455a-a205-81c84a8a7b68\") " pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.576362 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.576312 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"ce1e171c152e4994dbda02fc177e4774","Type":"ContainerStarted","Data":"b899f3a80099a964aab9674cb1c977ff0a6974def323395bacfc15ea7926ea83"} Jul 07 14:56:57.577601 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.577576 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"845a752d1238c1c0745a1068b7055128","Type":"ContainerStarted","Data":"ea999d8975da5c34f7820cfa94a34af97c1ad2a69aef213eef619b4db9ade7b5"} Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f466264-6a26-4389-a552-2e14f7f93464-agent-certs\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f466264-6a26-4389-a552-2e14f7f93464-konnectivity-ca\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-run\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mkdn\" (UniqueName: \"kubernetes.io/projected/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-kube-api-access-4mkdn\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysconfig\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-conf\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-serviceca\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-modprobe-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-host\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-systemd\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-kubernetes\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-lib-modules\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.657575 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-var-lib-kubelet\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-tmp\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997sl\" (UniqueName: \"kubernetes.io/projected/ae1f681f-2387-45ec-8897-a2d785895797-kube-api-access-997sl\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-sys\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-tuned\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-host\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657693 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpztj\" (UniqueName: \"kubernetes.io/projected/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-kube-api-access-jpztj\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-systemd\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-run\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.657842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f466264-6a26-4389-a552-2e14f7f93464-konnectivity-ca\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658083 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-modprobe-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.658102 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-host\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658342 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.658168 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:58.158150612 +0000 UTC m=+3.067392974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-lib-modules\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-serviceca\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-sys\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-kubernetes\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysconfig\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658356 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-var-lib-kubelet\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-host\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-d\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.658991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.658466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-sysctl-conf\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.660402 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.660362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f466264-6a26-4389-a552-2e14f7f93464-agent-certs\") pod \"konnectivity-agent-2d59v\" (UID: \"6f466264-6a26-4389-a552-2e14f7f93464\") " pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.660761 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.660736 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-etc-tuned\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.661605 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.661584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-tmp\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.667012 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.666988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpztj\" (UniqueName: \"kubernetes.io/projected/cbbf934f-f81c-4e97-a5af-89ff05f3a40f-kube-api-access-jpztj\") pod \"tuned-hzv5p\" (UID: \"cbbf934f-f81c-4e97-a5af-89ff05f3a40f\") " pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.667918 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.667893 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:57.668018 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.667925 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:57.668018 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.667952 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:57.668119 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:57.668040 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:56:58.168022011 +0000 UTC m=+3.077264379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:57.670384 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.670341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997sl\" (UniqueName: \"kubernetes.io/projected/ae1f681f-2387-45ec-8897-a2d785895797-kube-api-access-997sl\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:57.670725 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.670707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mkdn\" (UniqueName: \"kubernetes.io/projected/1e4ab939-1f6a-46d3-924f-2fa5db2bebaf-kube-api-access-4mkdn\") pod \"node-ca-ft6mk\" (UID: \"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf\") " pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:57.748176 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.748137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wftqr" Jul 07 14:56:57.756965 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.756943 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:56:57.768635 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.768606 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7q2cf" Jul 07 14:56:57.775587 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.775566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tws2n" Jul 07 14:56:57.784292 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.784268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" Jul 07 14:56:57.791201 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.791178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq4sp" Jul 07 14:56:57.800062 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.800042 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:56:57.814721 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.814694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" Jul 07 14:56:57.822404 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:57.822376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ft6mk" Jul 07 14:56:58.061462 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.061360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:58.061638 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.061520 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:58.061638 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.061582 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:56:59.061565299 +0000 UTC m=+3.970807674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:58.162556 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.162523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:58.162713 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.162643 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:58.162713 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.162701 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:59.162685727 +0000 UTC m=+4.071928086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:58.263420 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.263376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:58.263605 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.263558 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:58.263605 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.263582 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:58.263605 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.263592 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:58.263719 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.263656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:56:59.263641224 +0000 UTC m=+4.172883579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:58.520227 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.520142 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:51:57 +0000 UTC" deadline="2028-01-06 10:45:56.928450517 +0000 UTC" Jul 07 14:56:58.520227 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.520178 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13147h48m58.408276226s" Jul 07 14:56:58.569717 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.569681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:58.569901 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:58.569807 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:56:58.664859 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.664819 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4ab939_1f6a_46d3_924f_2fa5db2bebaf.slice/crio-d30eaa3fcc1a24afb3eba973ddf63e25ea8166f62bf44e36053c95ea218d2b87 WatchSource:0}: Error finding container d30eaa3fcc1a24afb3eba973ddf63e25ea8166f62bf44e36053c95ea218d2b87: Status 404 returned error can't find the container with id d30eaa3fcc1a24afb3eba973ddf63e25ea8166f62bf44e36053c95ea218d2b87 Jul 07 14:56:58.666995 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.666623 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f85b2e8_9b22_455a_a205_81c84a8a7b68.slice/crio-fc4e9603a8abebb388d2326a6ab7923352fa4c067c93a2033dd829571ec0f2a2 WatchSource:0}: Error finding container fc4e9603a8abebb388d2326a6ab7923352fa4c067c93a2033dd829571ec0f2a2: Status 404 returned error can't find the container with id fc4e9603a8abebb388d2326a6ab7923352fa4c067c93a2033dd829571ec0f2a2 Jul 07 14:56:58.671731 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.671022 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465fd64d_d6fa_4c50_8aa1_5cccea3cbbd7.slice/crio-1fc83383035030ad06b57a17c66d6e7cf152445da50f356f9b481b619e8006a9 WatchSource:0}: Error finding container 1fc83383035030ad06b57a17c66d6e7cf152445da50f356f9b481b619e8006a9: Status 404 returned error can't find the container with id 1fc83383035030ad06b57a17c66d6e7cf152445da50f356f9b481b619e8006a9 Jul 07 14:56:58.677820 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.677487 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285c5ba3_62c8_4edb_940d_5ae9f9e9150e.slice/crio-180ff4c1726ca679f99e3ca690245f74ff50a4978ab12591ca3baeee0967074b WatchSource:0}: Error finding container 180ff4c1726ca679f99e3ca690245f74ff50a4978ab12591ca3baeee0967074b: Status 404 returned error can't find the container with id 180ff4c1726ca679f99e3ca690245f74ff50a4978ab12591ca3baeee0967074b Jul 07 14:56:58.677896 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.677832 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f466264_6a26_4389_a552_2e14f7f93464.slice/crio-caf32c6635344bdc260d982b3028aae0a2c0a2ee88ed7c3cead2491c998cde01 WatchSource:0}: Error finding container caf32c6635344bdc260d982b3028aae0a2c0a2ee88ed7c3cead2491c998cde01: Status 404 returned error can't find the container with id caf32c6635344bdc260d982b3028aae0a2c0a2ee88ed7c3cead2491c998cde01 Jul 07 14:56:58.678037 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:56:58.678005 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2bfc63_8331_46a3_90d4_dba7d5da26ad.slice/crio-cac34b3a73f59b6bfb78c5588efdc9b91159d814b2613e16badf73f923a317ae WatchSource:0}: Error finding container cac34b3a73f59b6bfb78c5588efdc9b91159d814b2613e16badf73f923a317ae: Status 404 returned error can't find the container with id cac34b3a73f59b6bfb78c5588efdc9b91159d814b2613e16badf73f923a317ae Jul 07 14:56:58.874657 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:58.874374 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:59.069228 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.069197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:59.069403 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.069378 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:59.069503 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.069481 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.069455753 +0000 UTC m=+5.978698127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:59.171160 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.170471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:56:59.171160 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.170702 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:59.171160 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.170772 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.170750984 +0000 UTC m=+6.079993342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:59.270960 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.270881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:59.271151 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.271042 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:59.271151 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.271073 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:59.271151 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.271087 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:59.271301 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.271157 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.271135396 +0000 UTC m=+6.180377768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:59.325096 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.324888 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:59.520970 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.520878 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:51:57 +0000 UTC" deadline="2028-03-01 07:26:23.098569819 +0000 UTC" Jul 07 14:56:59.520970 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.520938 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14464h29m23.577636178s" Jul 07 14:56:59.573514 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.572589 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:56:59.573514 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.572716 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:56:59.573514 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.573062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:56:59.573514 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:56:59.573148 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:56:59.589222 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.589192 2558 generic.go:356] "Generic (PLEG): container finished" podID="845a752d1238c1c0745a1068b7055128" containerID="12389f1bba9c6b5754c8b10b8259b5307843e95e3e67527f112daf6da61c3085" exitCode=0 Jul 07 14:56:59.589363 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.589279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"845a752d1238c1c0745a1068b7055128","Type":"ContainerDied","Data":"12389f1bba9c6b5754c8b10b8259b5307843e95e3e67527f112daf6da61c3085"} Jul 07 14:56:59.592157 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.592133 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" event={"ID":"be305396-8a73-4d25-a243-e2550bb52c52","Type":"ContainerStarted","Data":"910f97f6430d5b2a06e2392d85cca1c9f6eff7fc1257dc4d3a78ef5046c861fd"} Jul 07 14:56:59.597158 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.597133 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d59v" event={"ID":"6f466264-6a26-4389-a552-2e14f7f93464","Type":"ContainerStarted","Data":"caf32c6635344bdc260d982b3028aae0a2c0a2ee88ed7c3cead2491c998cde01"} Jul 07 14:56:59.601400 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.601320 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"cac34b3a73f59b6bfb78c5588efdc9b91159d814b2613e16badf73f923a317ae"} Jul 07 14:56:59.611087 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.610960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerStarted","Data":"fc4e9603a8abebb388d2326a6ab7923352fa4c067c93a2033dd829571ec0f2a2"} Jul 07 14:56:59.629485 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.628838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" event={"ID":"ce1e171c152e4994dbda02fc177e4774","Type":"ContainerStarted","Data":"dc39146cebf9e0e97760cd32f8205025865668ec0f462fc8427a68cdb946b18f"} Jul 07 14:56:59.647157 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.647082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" event={"ID":"cbbf934f-f81c-4e97-a5af-89ff05f3a40f","Type":"ContainerStarted","Data":"8587038a6d72528afa5289b185e56b39682eb15082ceddaa783264fa4f8052fa"} Jul 07 14:56:59.666074 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.665999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq4sp" event={"ID":"285c5ba3-62c8-4edb-940d-5ae9f9e9150e","Type":"ContainerStarted","Data":"180ff4c1726ca679f99e3ca690245f74ff50a4978ab12591ca3baeee0967074b"} Jul 07 14:56:59.668703 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.668676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tws2n" event={"ID":"d2fa145d-725e-4243-b25e-0d4df112768e","Type":"ContainerStarted","Data":"2ae740e69626bbc839739066fe37817dd5d0d266d960f201b1bec25a7fab0d96"} Jul 07 14:56:59.683959 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.683928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7q2cf" event={"ID":"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7","Type":"ContainerStarted","Data":"1fc83383035030ad06b57a17c66d6e7cf152445da50f356f9b481b619e8006a9"} Jul 07 14:56:59.697932 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:56:59.697891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ft6mk" event={"ID":"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf","Type":"ContainerStarted","Data":"d30eaa3fcc1a24afb3eba973ddf63e25ea8166f62bf44e36053c95ea218d2b87"} Jul 07 14:57:00.570181 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:00.570145 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:00.570665 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:00.570313 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:00.734903 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:00.734866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" event={"ID":"845a752d1238c1c0745a1068b7055128","Type":"ContainerStarted","Data":"e395722a7fabf2cbf1919b9d51f094c143721406cdffa7e5f01d49486b44c681"} Jul 07 14:57:00.755156 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:00.753954 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-241.ec2.internal" podStartSLOduration=3.753934398 podStartE2EDuration="3.753934398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:59.649502402 +0000 UTC m=+4.558744791" watchObservedRunningTime="2026-07-07 14:57:00.753934398 +0000 UTC m=+5.663176779" Jul 07 14:57:01.084738 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:01.084697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:01.084930 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.084857 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:01.084930 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.084921 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:57:05.084902594 +0000 UTC m=+9.994144952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:01.185115 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:01.185074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:01.185282 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.185263 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:01.185336 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.185326 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:05.185308098 +0000 UTC m=+10.094550472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:01.285585 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:01.285548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:01.285766 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.285729 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:01.285766 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.285749 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:01.285766 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.285764 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:01.285934 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.285830 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:57:05.28581105 +0000 UTC m=+10.195053420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:01.573042 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:01.572210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:01.573042 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.572339 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:01.573042 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:01.572830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:01.573042 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:01.572931 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:02.569549 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:02.569517 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:02.569744 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:02.569669 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:03.570165 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:03.569614 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:03.570165 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:03.569614 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:03.570165 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:03.569745 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:03.570165 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:03.569861 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:04.569926 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:04.569886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:04.570129 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:04.570041 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:05.116794 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:05.116583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:05.116794 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.116752 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:05.117373 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.116820 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:57:13.116801299 +0000 UTC m=+18.026043654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:05.217893 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:05.217739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:05.217893 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.217889 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:05.218151 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.217951 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:13.217932907 +0000 UTC m=+18.127175264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:05.318750 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:05.318712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:05.318983 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.318870 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:05.318983 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.318894 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:05.318983 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.318909 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:05.318983 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.318970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:57:13.318950531 +0000 UTC m=+18.228192892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:05.570786 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:05.570233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:05.570786 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.570344 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:05.571237 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:05.571096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:05.571237 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:05.571199 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:06.570147 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:06.570114 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:06.570650 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:06.570270 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:07.570656 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:07.569987 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:07.570656 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:07.570114 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:07.570656 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:07.570515 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:07.570656 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:07.570610 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:08.569761 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:08.569725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:08.569938 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:08.569855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:09.569705 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:09.569623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:09.570103 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:09.569765 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:09.570103 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:09.569820 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:09.570103 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:09.569949 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:10.570201 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:10.570160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:10.570629 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:10.570307 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:11.569480 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:11.569432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:11.569649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:11.569454 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:11.569649 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:11.569577 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:11.569786 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:11.569642 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:12.570014 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:12.569972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:12.570535 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:12.570111 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:13.182935 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:13.182886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:13.183092 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.183050 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:13.183168 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.183119 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:57:29.183099914 +0000 UTC m=+34.092342270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:13.284158 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:13.284126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:13.284333 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.284252 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:13.284333 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.284309 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:29.2842958 +0000 UTC m=+34.193538156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:13.384738 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:13.384699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:13.384893 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.384864 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:13.384893 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.384894 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:13.384981 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.384904 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:13.384981 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.384957 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:57:29.384941852 +0000 UTC m=+34.294184213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:13.569534 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:13.569434 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:13.569688 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.569586 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:13.569688 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:13.569604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:13.569865 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:13.569725 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:14.569228 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:14.569203 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:14.569689 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:14.569314 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:15.570320 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:15.570287 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:15.570791 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:15.570398 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:15.570791 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:15.570492 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:15.570791 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:15.570595 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:16.570252 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:16.570209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:16.570411 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:16.570358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:17.570942 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.570385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:17.570942 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:17.570733 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:17.570942 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.570538 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:17.570942 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:17.570893 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:17.770582 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.770272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" event={"ID":"cbbf934f-f81c-4e97-a5af-89ff05f3a40f","Type":"ContainerStarted","Data":"81df02081468bbf594bc3722e761e1e92145bbc743ee0c84491f0cd496c521b9"} Jul 07 14:57:17.772017 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.771976 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq4sp" event={"ID":"285c5ba3-62c8-4edb-940d-5ae9f9e9150e","Type":"ContainerStarted","Data":"9ccc8a5119764551f899accdc6fe72cece67c18edecedce14cc377d7c0581780"} Jul 07 14:57:17.775618 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.775575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tws2n" event={"ID":"d2fa145d-725e-4243-b25e-0d4df112768e","Type":"ContainerStarted","Data":"f26ef0d8782eb395c33a1bcebd7984cc82bea31ed860618534e7d198cec524a6"} Jul 07 14:57:17.778187 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.778163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ft6mk" event={"ID":"1e4ab939-1f6a-46d3-924f-2fa5db2bebaf","Type":"ContainerStarted","Data":"98125948aa4921998c85962faade9201c1e3c0a87c82f4a68f769e03440220d7"} Jul 07 14:57:17.779711 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.779689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" event={"ID":"be305396-8a73-4d25-a243-e2550bb52c52","Type":"ContainerStarted","Data":"6bb5e14791484b24ba2d335827fc89ce28c785908937f5607b6fe34f30aa907b"} Jul 07 14:57:17.781028 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.781008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d59v" event={"ID":"6f466264-6a26-4389-a552-2e14f7f93464","Type":"ContainerStarted","Data":"0448ab85c6595dfcd58cc0b1ed2483c45a736fd2222837f7514be5a79866930d"} Jul 07 14:57:17.783033 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.783011 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"f41a18b6d2883589b13e34a6970162b79395cb69df09c42900b34ce3026b4ee5"} Jul 07 14:57:17.783127 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.783062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"d662436f57af402ea33031d9ef00d77dd8bbee00f979c4ad763824a3c09fda7c"} Jul 07 14:57:17.783127 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.783091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"2955925b3e77dc9b142f934002a5b67d22ecd38ffadab213aa607f8fa076dbae"} Jul 07 14:57:17.784552 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.784530 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="60c91d7692fca1e4a7fd70ceaf8b11960a160e1e8eec8325efb5b49de77d1327" exitCode=0 Jul 07 14:57:17.784717 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.784565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"60c91d7692fca1e4a7fd70ceaf8b11960a160e1e8eec8325efb5b49de77d1327"} Jul 07 14:57:17.801275 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.801232 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-241.ec2.internal" podStartSLOduration=20.801218686 podStartE2EDuration="20.801218686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:00.755138782 +0000 UTC m=+5.664381160" watchObservedRunningTime="2026-07-07 14:57:17.801218686 +0000 UTC m=+22.710461069" Jul 07 14:57:17.801428 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.801410 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hzv5p" podStartSLOduration=4.065087804 podStartE2EDuration="22.801403216s" totalImagesPullingTime="18.736315412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.80118216 +0000 UTC m=+22.710424538" watchObservedRunningTime="2026-07-07 14:57:17.801403216 +0000 UTC m=+22.710645592" Jul 07 14:57:17.866486 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.866421 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tws2n" podStartSLOduration=4.154630427 podStartE2EDuration="22.866407395s" totalImagesPullingTime="18.711776968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.836619814 +0000 UTC m=+22.745862192" watchObservedRunningTime="2026-07-07 14:57:17.866407395 +0000 UTC m=+22.775649773" Jul 07 14:57:17.866846 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.866819 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cq4sp" podStartSLOduration=4.102901713 podStartE2EDuration="22.866811179s" totalImagesPullingTime="18.763909466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.866332032 +0000 UTC m=+22.775574410" watchObservedRunningTime="2026-07-07 14:57:17.866811179 +0000 UTC m=+22.776053556" Jul 07 14:57:17.913412 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.913372 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2d59v" podStartSLOduration=12.406462362 podStartE2EDuration="22.913357483s" totalImagesPullingTime="10.506895121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.884037517 +0000 UTC m=+22.793279906" watchObservedRunningTime="2026-07-07 14:57:17.913357483 +0000 UTC m=+22.822599859" Jul 07 14:57:17.936669 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:17.936624 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ft6mk" podStartSLOduration=4.21833823 podStartE2EDuration="22.936607489s" totalImagesPullingTime="18.718269259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.936346216 +0000 UTC m=+22.845588595" watchObservedRunningTime="2026-07-07 14:57:17.936607489 +0000 UTC m=+22.845849864" Jul 07 14:57:18.570260 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:18.570225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:18.570459 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:18.570380 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:18.789547 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:18.789508 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"dc0f1ded1d633828968cc3d4bafb575162e54976f1c8adeeb2e3498349347453"} Jul 07 14:57:18.790382 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:18.789581 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"a102341acbdeb55bef411e7175f71b87128cd5c10a5c0d5b20c552a81b170ce9"} Jul 07 14:57:18.790382 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:18.789613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"a9412bfc5ca2df0ccf90f6fa831e2993432b85a1f643e37b62de90434bc4950b"} Jul 07 14:57:18.922052 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:18.922028 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:57:19.513167 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.513065 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:57:18.922045769Z","UUID":"b35f9b5c-a639-4659-a2e9-212f4be8a7c0","Handler":null,"Name":"","Endpoint":""} Jul 07 14:57:19.515006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.514984 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:57:19.515140 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.515026 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:57:19.569956 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.569926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:19.570136 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.569972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:19.570136 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:19.570069 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:19.570250 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:19.570200 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:19.794089 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.794000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7q2cf" event={"ID":"465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7","Type":"ContainerStarted","Data":"0bf50d2f6802bc29a8e0ff324841e565cdcdcf23572c8f2e213fe1e28fc5112c"} Jul 07 14:57:19.796129 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.796100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" event={"ID":"be305396-8a73-4d25-a243-e2550bb52c52","Type":"ContainerStarted","Data":"2f208000f4e141eb2f96c9959f78734e9ad5e431dfab435b13b2cdeecede47f5"} Jul 07 14:57:19.827012 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:19.826951 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7q2cf" podStartSLOduration=6.112317836 podStartE2EDuration="24.826936217s" totalImagesPullingTime="18.714618381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:19.826718335 +0000 UTC m=+24.735960714" watchObservedRunningTime="2026-07-07 14:57:19.826936217 +0000 UTC m=+24.736178593" Jul 07 14:57:20.570163 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:20.570132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:20.570403 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:20.570243 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:20.802403 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:20.802365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"e1b27df0330c95f8c66fe52ee6fe69eccac304f59b4e0b53ab40f2be7f49403b"} Jul 07 14:57:20.805020 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:20.804980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" event={"ID":"be305396-8a73-4d25-a243-e2550bb52c52","Type":"ContainerStarted","Data":"2e80225aea34183b6b22295f3153ab68804ae48e0a30475da9a3584c0ff4e97b"} Jul 07 14:57:20.825143 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:20.825053 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ll5qs" podStartSLOduration=4.895093794 podStartE2EDuration="25.825035299s" totalImagesPullingTime="20.929941505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:20.82441701 +0000 UTC m=+25.733659409" watchObservedRunningTime="2026-07-07 14:57:20.825035299 +0000 UTC m=+25.734277677" Jul 07 14:57:21.570007 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:21.569780 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:21.570185 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:21.569830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:21.570185 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:21.570117 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:21.570185 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:21.570175 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:22.260935 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.260896 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:57:22.261553 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.261532 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:57:22.569274 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.569201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:22.569417 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:22.569324 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:22.814525 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.814415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" event={"ID":"9e2bfc63-8331-46a3-90d4-dba7d5da26ad","Type":"ContainerStarted","Data":"debda34deee5e5d2f563b0c614458864aca4b303e213d98815fa3cc0e0f0fee1"} Jul 07 14:57:22.814677 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.814545 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:57:22.815481 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.815196 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2d59v" Jul 07 14:57:22.846756 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:22.846712 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" podStartSLOduration=9.066098298 podStartE2EDuration="27.846696905s" totalImagesPullingTime="18.780598607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:22.845706984 +0000 UTC m=+27.754949361" watchObservedRunningTime="2026-07-07 14:57:22.846696905 +0000 UTC m=+27.755939282" Jul 07 14:57:23.570299 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.570009 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:23.570999 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.570070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:23.570999 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:23.570381 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:23.570999 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:23.570407 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:23.818456 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.818412 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="99b45010a241b1dfe87454d4b11b9c7ab35d8479452a107b2d4437989424d715" exitCode=0 Jul 07 14:57:23.818628 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.818502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"99b45010a241b1dfe87454d4b11b9c7ab35d8479452a107b2d4437989424d715"} Jul 07 14:57:23.818628 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.818607 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 14:57:23.819802 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.819219 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:23.819802 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.819304 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:23.835045 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.835022 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:23.835154 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:23.835117 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:24.569414 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.569386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:24.569651 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:24.569517 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:24.820860 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.820809 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 14:57:24.973933 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.973749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vjmx9"] Jul 07 14:57:24.974118 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.974036 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:24.974189 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:24.974150 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:24.976392 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.976369 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-br4bh"] Jul 07 14:57:24.976514 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.976478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:24.976577 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:24.976561 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:24.979234 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.979213 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljwlj"] Jul 07 14:57:24.979472 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:24.979306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:24.979472 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:24.979393 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:25.827924 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:25.827894 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="e18db19a857720a27d0f99dcb035260742a53d4933d1165161105ed67b32efbc" exitCode=0 Jul 07 14:57:25.828289 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:25.827978 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"e18db19a857720a27d0f99dcb035260742a53d4933d1165161105ed67b32efbc"} Jul 07 14:57:25.828289 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:25.828041 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 14:57:26.393669 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:26.393636 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:26.570229 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:26.570198 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:26.570229 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:26.570218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:26.570435 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:26.570218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:26.570435 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:26.570305 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:26.570435 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:26.570366 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:26.570561 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:26.570435 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:27.835164 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:27.835129 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="223eb60185fe0dfe764e08ae30b49ac17f214904a6f6495679a546c34ff5b108" exitCode=0 Jul 07 14:57:27.835790 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:27.835179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"223eb60185fe0dfe764e08ae30b49ac17f214904a6f6495679a546c34ff5b108"} Jul 07 14:57:28.569699 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:28.569616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:28.569699 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:28.569640 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:28.569699 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:28.569617 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:28.569991 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:28.569745 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjmx9" podUID="68361114-6254-43a5-a56c-3d5a5335dd8c" Jul 07 14:57:28.569991 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:28.569816 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ljwlj" podUID="0575b88b-6224-4385-a4fa-a8ea278c3ddd" Jul 07 14:57:28.569991 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:28.569907 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-br4bh" podUID="ae1f681f-2387-45ec-8897-a2d785895797" Jul 07 14:57:29.205002 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:29.204960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:29.205430 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.205122 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:29.205430 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.205196 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret podName:68361114-6254-43a5-a56c-3d5a5335dd8c nodeName:}" failed. No retries permitted until 2026-07-07 14:58:01.205179053 +0000 UTC m=+66.114421416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret") pod "global-pull-secret-syncer-vjmx9" (UID: "68361114-6254-43a5-a56c-3d5a5335dd8c") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:29.306214 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:29.306182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:29.306391 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.306343 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:29.306471 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.306416 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs podName:ae1f681f-2387-45ec-8897-a2d785895797 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:01.306395086 +0000 UTC m=+66.215637445 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs") pod "network-metrics-daemon-br4bh" (UID: "ae1f681f-2387-45ec-8897-a2d785895797") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:29.394003 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:29.393956 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:29.406952 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:29.406920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:29.407133 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.407113 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:29.407193 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.407143 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:29.407193 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.407156 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkcvq for pod openshift-network-diagnostics/network-check-target-ljwlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:29.407267 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:29.407215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq podName:0575b88b-6224-4385-a4fa-a8ea278c3ddd nodeName:}" failed. No retries permitted until 2026-07-07 14:58:01.407197346 +0000 UTC m=+66.316439704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkcvq" (UniqueName: "kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq") pod "network-check-target-ljwlj" (UID: "0575b88b-6224-4385-a4fa-a8ea278c3ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:29.523048 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:29.522970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:30.416501 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.416473 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-241.ec2.internal" event="NodeReady" Jul 07 14:57:30.416939 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.416628 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:57:30.480180 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.480146 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-swmqs"] Jul 07 14:57:30.482749 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.482726 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.485029 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.484862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jkfb7\"" Jul 07 14:57:30.485029 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.484868 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vnfdt"] Jul 07 14:57:30.485029 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.484923 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:57:30.485029 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.484934 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:57:30.486595 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.486578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.489228 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.489197 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kbzh7\"" Jul 07 14:57:30.489476 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.489419 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:57:30.489688 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.489669 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:57:30.491767 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.491752 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:57:30.496396 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.496375 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-swmqs"] Jul 07 14:57:30.510380 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.510351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnfdt"] Jul 07 14:57:30.569665 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.569637 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:57:30.569857 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.569739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:57:30.569944 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.569926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:57:30.571995 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.571973 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:57:30.572124 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.572030 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:57:30.572872 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.572848 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:57:30.573075 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.573044 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9sm\"" Jul 07 14:57:30.573457 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.573343 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:57:30.573994 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.573789 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xq58\"" Jul 07 14:57:30.615722 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615688 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jblvt\" (UniqueName: \"kubernetes.io/projected/4671c654-3695-467b-8745-106c8d5e9bc9-kube-api-access-jblvt\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.615891 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzqt\" (UniqueName: \"kubernetes.io/projected/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-kube-api-access-mpzqt\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.615891 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4671c654-3695-467b-8745-106c8d5e9bc9-config-volume\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.616006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-cert\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.616006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4671c654-3695-467b-8745-106c8d5e9bc9-tmp-dir\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.616006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.615979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.716676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzqt\" (UniqueName: \"kubernetes.io/projected/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-kube-api-access-mpzqt\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.716676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4671c654-3695-467b-8745-106c8d5e9bc9-config-volume\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.716676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-cert\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.716957 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4671c654-3695-467b-8745-106c8d5e9bc9-tmp-dir\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.716957 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.716957 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.716924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jblvt\" (UniqueName: \"kubernetes.io/projected/4671c654-3695-467b-8745-106c8d5e9bc9-kube-api-access-jblvt\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.717111 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:30.717088 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:30.717211 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:30.717155 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:31.217135108 +0000 UTC m=+36.126377463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:30.717211 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.717188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4671c654-3695-467b-8745-106c8d5e9bc9-tmp-dir\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.717313 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.717269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4671c654-3695-467b-8745-106c8d5e9bc9-config-volume\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.721948 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.721923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-cert\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.725890 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.725650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jblvt\" (UniqueName: \"kubernetes.io/projected/4671c654-3695-467b-8745-106c8d5e9bc9-kube-api-access-jblvt\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:30.726214 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.725888 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzqt\" (UniqueName: \"kubernetes.io/projected/7d1ae07e-71f5-43ab-b55c-f46e745ddee6-kube-api-access-mpzqt\") pod \"ingress-canary-vnfdt\" (UID: \"7d1ae07e-71f5-43ab-b55c-f46e745ddee6\") " pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:30.801784 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:30.801752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vnfdt" Jul 07 14:57:31.221271 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:31.221237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:31.221478 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:31.221354 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:31.221478 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:31.221407 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:32.221394033 +0000 UTC m=+37.130636387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:31.999859 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:31.999825 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vnfdt"] Jul 07 14:57:32.004637 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:57:32.004592 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1ae07e_71f5_43ab_b55c_f46e745ddee6.slice/crio-3ddb22d67cd5a6526915c5f73c14e2c7d357c37dd81c33562650140e3b941588 WatchSource:0}: Error finding container 3ddb22d67cd5a6526915c5f73c14e2c7d357c37dd81c33562650140e3b941588: Status 404 returned error can't find the container with id 3ddb22d67cd5a6526915c5f73c14e2c7d357c37dd81c33562650140e3b941588 Jul 07 14:57:32.101111 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:32.101082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:32.230410 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:32.230327 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:32.230570 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:32.230477 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:32.230570 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:32.230534 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.230516499 +0000 UTC m=+39.139758854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:32.850260 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:32.850220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnfdt" event={"ID":"7d1ae07e-71f5-43ab-b55c-f46e745ddee6","Type":"ContainerStarted","Data":"3ddb22d67cd5a6526915c5f73c14e2c7d357c37dd81c33562650140e3b941588"} Jul 07 14:57:32.853347 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:32.853316 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="919021ac8956a8c9481d4a7d0895e318b71f9af1385d692fbbc32400ee867574" exitCode=0 Jul 07 14:57:32.853477 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:32.853364 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"919021ac8956a8c9481d4a7d0895e318b71f9af1385d692fbbc32400ee867574"} Jul 07 14:57:33.714214 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.713998 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8"] Jul 07 14:57:33.716723 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.716699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.720908 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.720875 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 14:57:33.721344 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.721304 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.721344 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.721315 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 14:57:33.721542 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.721383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v45g9\"" Jul 07 14:57:33.721542 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.721502 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.721757 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.721736 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-94cf677fc-f7dtf"] Jul 07 14:57:33.724085 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.724053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.726464 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.726418 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 14:57:33.726650 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.726630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8ft4t\"" Jul 07 14:57:33.727544 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.727512 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 14:57:33.727798 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.727782 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 14:57:33.728036 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.728016 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 14:57:33.728137 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.728086 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.728408 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.728387 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8"] Jul 07 14:57:33.729232 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.729208 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.739886 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.739026 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94cf677fc-f7dtf"] Jul 07 14:57:33.835812 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.835708 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg"] Jul 07 14:57:33.837964 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.837938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:33.842526 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.842431 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-npmrf\"" Jul 07 14:57:33.842836 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.842814 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.842946 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.842841 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 14:57:33.842946 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.842852 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.843067 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.843122 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.843196 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-default-certificate\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.843270 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgz6d\" (UniqueName: \"kubernetes.io/projected/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-kube-api-access-wgz6d\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.843334 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwcdg\" (UniqueName: \"kubernetes.io/projected/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-kube-api-access-lwcdg\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.843334 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-stats-auth\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.843415 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.843415 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.843393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.858899 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.858871 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg"] Jul 07 14:57:33.862808 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.862782 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f85b2e8-9b22-455a-a205-81c84a8a7b68" containerID="79f5479cf6274cd14f7f97b0f2924563bc06dc33f2ec06340cc7fcb3fab853ba" exitCode=0 Jul 07 14:57:33.863022 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.862860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerDied","Data":"79f5479cf6274cd14f7f97b0f2924563bc06dc33f2ec06340cc7fcb3fab853ba"} Jul 07 14:57:33.909240 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.909202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:33.924184 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.924150 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:57:33.928027 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.928006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:33.933074 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.933048 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:57:33.933225 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.933208 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:57:33.933893 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.933877 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dqrsp\"" Jul 07 14:57:33.934003 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.933915 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:57:33.939296 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.939280 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:57:33.943963 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.943925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.944090 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.943962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.944090 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-default-certificate\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.944090 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgz6d\" (UniqueName: \"kubernetes.io/projected/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-kube-api-access-wgz6d\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.944237 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:33.944091 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.444070568 +0000 UTC m=+39.353312946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:33.944237 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwl8l\" (UniqueName: \"kubernetes.io/projected/8549e815-c4b1-4ca0-b49f-749216db6b38-kube-api-access-lwl8l\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:33.944237 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwcdg\" (UniqueName: \"kubernetes.io/projected/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-kube-api-access-lwcdg\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.944237 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-stats-auth\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.944427 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.944427 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.944427 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:33.944427 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:33.944367 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:33.945019 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:33.944456 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:33.945019 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:33.944424 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.444407668 +0000 UTC m=+39.353650051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:33.945019 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:33.944576 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.444560528 +0000 UTC m=+39.353802883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:33.945019 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.944757 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:57:33.945217 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.945139 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:33.948927 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.948901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-stats-auth\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.949092 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.948907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-default-certificate\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.955938 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.955917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgz6d\" (UniqueName: \"kubernetes.io/projected/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-kube-api-access-wgz6d\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:33.956337 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:33.956317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwcdg\" (UniqueName: \"kubernetes.io/projected/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-kube-api-access-lwcdg\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:34.014880 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.014782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:34.045360 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwl8l\" (UniqueName: \"kubernetes.io/projected/8549e815-c4b1-4ca0-b49f-749216db6b38-kube-api-access-lwl8l\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:34.045360 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045360 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6np5b\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045672 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045672 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:34.045672 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045822 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045822 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045822 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.045712 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 14:57:34.045822 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045748 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.045822 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.045764 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls podName:8549e815-c4b1-4ca0-b49f-749216db6b38 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.545749334 +0000 UTC m=+39.454991694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj5pg" (UID: "8549e815-c4b1-4ca0-b49f-749216db6b38") : secret "samples-operator-tls" not found Jul 07 14:57:34.046053 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.045844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.054714 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.054687 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwl8l\" (UniqueName: \"kubernetes.io/projected/8549e815-c4b1-4ca0-b49f-749216db6b38-kube-api-access-lwl8l\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:34.146966 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.146930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.147132 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.146978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6np5b\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.147132 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.147013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.147132 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.147069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.147838 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.147682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.147838 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.147783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.148033 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.147895 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:34.148033 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.147913 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:34.148033 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.147970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.647950176 +0000 UTC m=+39.557192546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:34.148792 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.148763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.148909 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.148832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.148909 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.148874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.149090 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.149063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.149262 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.149216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.150636 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.150616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.150975 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.150959 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.157063 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.157041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.157063 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.157061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6np5b\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.249592 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.249565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:34.249717 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.249691 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:34.249761 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.249741 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:38.249728869 +0000 UTC m=+43.158971228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:34.451249 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.451212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:34.451398 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.451283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:34.451398 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.451345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:34.451398 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.451372 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:35.451358933 +0000 UTC m=+40.360601287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:34.451521 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.451419 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:34.451521 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.451472 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:34.451575 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.451525 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:35.451512931 +0000 UTC m=+40.360755290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:34.451575 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.451539 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:35.451532831 +0000 UTC m=+40.360775190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:34.552338 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.552262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:34.552479 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.552397 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 14:57:34.552519 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.552480 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls podName:8549e815-c4b1-4ca0-b49f-749216db6b38 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:35.552461301 +0000 UTC m=+40.461703657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj5pg" (UID: "8549e815-c4b1-4ca0-b49f-749216db6b38") : secret "samples-operator-tls" not found Jul 07 14:57:34.652824 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.652788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:34.652953 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.652933 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:34.652953 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.652950 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:34.653015 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:34.653004 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:35.652987951 +0000 UTC m=+40.562230306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:34.867598 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.867505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vnfdt" event={"ID":"7d1ae07e-71f5-43ab-b55c-f46e745ddee6","Type":"ContainerStarted","Data":"8b47f5341e603c6bc07b2968a4524a0f0bc011bbcb5bca7ccfd29d0a5a81f205"} Jul 07 14:57:34.871180 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.871156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wftqr" event={"ID":"3f85b2e8-9b22-455a-a205-81c84a8a7b68","Type":"ContainerStarted","Data":"699e6e7b97110fe557113f956ea9513517a6a91c573022cf4b851a04c2cdfc10"} Jul 07 14:57:34.886812 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.886773 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vnfdt" podStartSLOduration=2.7091528719999998 podStartE2EDuration="4.886759429s" totalImagesPullingTime="2.177606557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:34.886004483 +0000 UTC m=+39.795246862" watchObservedRunningTime="2026-07-07 14:57:34.886759429 +0000 UTC m=+39.796001806" Jul 07 14:57:34.913918 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:34.913867 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wftqr" podStartSLOduration=10.081767114 podStartE2EDuration="39.91385039s" totalImagesPullingTime="29.832083276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:34.91339334 +0000 UTC m=+39.822635728" watchObservedRunningTime="2026-07-07 14:57:34.91385039 +0000 UTC m=+39.823092767" Jul 07 14:57:35.072135 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.072103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:35.171429 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.171353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:35.459407 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.459361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.459433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.459469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.459523 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.459573 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.459587 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:37.459572687 +0000 UTC m=+42.368815042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:35.459617 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.459614 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:37.459603358 +0000 UTC m=+42.368845713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:35.459837 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.459635 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:37.459619481 +0000 UTC m=+42.368861863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:35.559775 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.559738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:35.559942 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.559866 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 14:57:35.559942 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.559924 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls podName:8549e815-c4b1-4ca0-b49f-749216db6b38 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:37.559909705 +0000 UTC m=+42.469152065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj5pg" (UID: "8549e815-c4b1-4ca0-b49f-749216db6b38") : secret "samples-operator-tls" not found Jul 07 14:57:35.661237 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:35.661198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:35.661409 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.661314 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:35.661409 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.661327 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:35.661409 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:35.661374 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:37.66136153 +0000 UTC m=+42.570603884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:37.476180 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:37.476135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:37.476180 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:37.476181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.476311 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:41.476293673 +0000 UTC m=+46.385536028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.476328 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.476387 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:41.47636521 +0000 UTC m=+46.385607573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:37.476418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.476554 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:37.476723 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.476602 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:41.476592562 +0000 UTC m=+46.385834922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:37.577690 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:37.577660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:37.577857 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.577770 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 14:57:37.577857 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.577816 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls podName:8549e815-c4b1-4ca0-b49f-749216db6b38 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:41.577804648 +0000 UTC m=+46.487047003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj5pg" (UID: "8549e815-c4b1-4ca0-b49f-749216db6b38") : secret "samples-operator-tls" not found Jul 07 14:57:37.678374 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:37.678336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:37.678558 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.678533 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:37.678610 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.678561 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:37.678640 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:37.678619 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:41.678603087 +0000 UTC m=+46.587845442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:38.284304 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.284272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:38.284487 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.284395 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:38.284487 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.284468 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:46.284433705 +0000 UTC m=+51.193676060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:38.350939 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.350902 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sdnbn"] Jul 07 14:57:38.379453 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.379399 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdnbn"] Jul 07 14:57:38.379603 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.379548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.381986 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.381954 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:57:38.381986 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.381975 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pp4t\"" Jul 07 14:57:38.382195 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.382067 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:57:38.382195 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.382106 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:57:38.382195 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.382125 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:57:38.395714 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.395686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:38.463537 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.463507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:38.486568 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.486540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-crio-socket\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.486887 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.486582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.486887 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.486650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vx2\" (UniqueName: \"kubernetes.io/projected/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-api-access-q2vx2\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.486887 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.486711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.486887 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.486825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-data-volume\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587492 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587409 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587492 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vx2\" (UniqueName: \"kubernetes.io/projected/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-api-access-q2vx2\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587659 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587659 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.587555 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:38.587659 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.587618 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:38.587659 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.587635 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:39.08761099 +0000 UTC m=+43.996853345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:38.587843 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:38.587665 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:39.087649181 +0000 UTC m=+43.996891540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : configmap "kube-rbac-proxy" not found Jul 07 14:57:38.587843 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-data-volume\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587843 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-crio-socket\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.587991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.587935 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-crio-socket\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.588073 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.588052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-data-volume\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:38.596765 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:38.596741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vx2\" (UniqueName: \"kubernetes.io/projected/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-api-access-q2vx2\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:39.091869 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:39.091830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:39.092065 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:39.091903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:39.092065 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:39.091976 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:39.092065 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:39.092037 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:40.092023107 +0000 UTC m=+45.001265463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:39.092065 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:39.092036 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:39.092218 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:39.092098 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:40.092080208 +0000 UTC m=+45.001322577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : configmap "kube-rbac-proxy" not found Jul 07 14:57:40.099432 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:40.099392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:40.099878 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:40.099483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:40.099878 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:40.099566 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:40.099878 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:40.099573 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:40.099878 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:40.099617 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.099603611 +0000 UTC m=+47.008845981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : configmap "kube-rbac-proxy" not found Jul 07 14:57:40.099878 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:40.099642 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.099624418 +0000 UTC m=+47.008866773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:40.169049 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:40.169023 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tws2n_d2fa145d-725e-4243-b25e-0d4df112768e/dns-node-resolver/0.log" Jul 07 14:57:40.967526 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:40.967498 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ft6mk_1e4ab939-1f6a-46d3-924f-2fa5db2bebaf/node-ca/0.log" Jul 07 14:57:41.223485 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.223341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:41.294752 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.294720 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd"] Jul 07 14:57:41.325008 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.324978 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd"] Jul 07 14:57:41.325149 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.325073 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" Jul 07 14:57:41.328622 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.328602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bkhqt\"" Jul 07 14:57:41.328840 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.328825 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:41.329749 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.329730 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 14:57:41.351998 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.351965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:41.408588 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.408549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmr5\" (UniqueName: \"kubernetes.io/projected/a83cdadb-5928-42c1-a58a-091773738978-kube-api-access-gpmr5\") pod \"migrator-d57d58cc9-zxzkd\" (UID: \"a83cdadb-5928-42c1-a58a-091773738978\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" Jul 07 14:57:41.447674 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.447647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:41.509063 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.508995 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:41.509147 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.509116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:41.509147 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.509131 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:41.509247 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.509189 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:49.509174656 +0000 UTC m=+54.418417011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:41.509247 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.509136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:41.509247 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.509227 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:49.509213298 +0000 UTC m=+54.418455681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:41.509404 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.509272 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:41.509404 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.509327 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:49.509312109 +0000 UTC m=+54.418554479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:41.509404 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.509272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmr5\" (UniqueName: \"kubernetes.io/projected/a83cdadb-5928-42c1-a58a-091773738978-kube-api-access-gpmr5\") pod \"migrator-d57d58cc9-zxzkd\" (UID: \"a83cdadb-5928-42c1-a58a-091773738978\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" Jul 07 14:57:41.520224 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.520200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmr5\" (UniqueName: \"kubernetes.io/projected/a83cdadb-5928-42c1-a58a-091773738978-kube-api-access-gpmr5\") pod \"migrator-d57d58cc9-zxzkd\" (UID: \"a83cdadb-5928-42c1-a58a-091773738978\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" Jul 07 14:57:41.610598 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.610566 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:41.610770 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.610668 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 14:57:41.610770 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.610720 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls podName:8549e815-c4b1-4ca0-b49f-749216db6b38 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:49.610706782 +0000 UTC m=+54.519949138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-kj5pg" (UID: "8549e815-c4b1-4ca0-b49f-749216db6b38") : secret "samples-operator-tls" not found Jul 07 14:57:41.634195 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.634170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" Jul 07 14:57:41.711579 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.711546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:41.711712 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.711701 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:41.711754 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.711717 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:41.711789 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:41.711773 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:49.711759507 +0000 UTC m=+54.621001881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:41.768052 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.767977 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd"] Jul 07 14:57:41.768877 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.768859 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnfdt_7d1ae07e-71f5-43ab-b55c-f46e745ddee6/serve-healthcheck-canary/0.log" Jul 07 14:57:41.771428 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:57:41.771394 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83cdadb_5928_42c1_a58a_091773738978.slice/crio-e60c742aa7db1825569289d19f8edfbb5784860a5172a9c53fbed8bedbb357d6 WatchSource:0}: Error finding container e60c742aa7db1825569289d19f8edfbb5784860a5172a9c53fbed8bedbb357d6: Status 404 returned error can't find the container with id e60c742aa7db1825569289d19f8edfbb5784860a5172a9c53fbed8bedbb357d6 Jul 07 14:57:41.814765 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.814733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:41.882144 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.882115 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:41.887857 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:41.887828 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" event={"ID":"a83cdadb-5928-42c1-a58a-091773738978","Type":"ContainerStarted","Data":"e60c742aa7db1825569289d19f8edfbb5784860a5172a9c53fbed8bedbb357d6"} Jul 07 14:57:42.115235 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.115150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:42.115235 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.115221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:42.115423 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:42.115298 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:42.115423 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:42.115318 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:42.115423 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:42.115380 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:46.11536345 +0000 UTC m=+51.024605806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : configmap "kube-rbac-proxy" not found Jul 07 14:57:42.115423 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:42.115394 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:46.115387773 +0000 UTC m=+51.024630128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:42.172760 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.172728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:42.255592 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.255563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:42.365111 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.365076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:42.466721 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.466682 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:42.932453 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:42.932404 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.027722 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.027690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.275144 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.275044 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.404794 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.404759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.517677 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.517647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.681027 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.681003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.776944 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.776905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:43.894785 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.894703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" event={"ID":"a83cdadb-5928-42c1-a58a-091773738978","Type":"ContainerStarted","Data":"d71a1887d159bfbc756005038e09cacb2b7de1318c7ba3cb9fec7563ade32dcd"} Jul 07 14:57:43.894785 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.894755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" event={"ID":"a83cdadb-5928-42c1-a58a-091773738978","Type":"ContainerStarted","Data":"42838dab4c54737a5cdd51615cd7edb3118d9563d9eadd68cc59f427a3269906"} Jul 07 14:57:43.913334 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:43.913281 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxzkd" podStartSLOduration=1.170994472 podStartE2EDuration="2.913263525s" totalImagesPullingTime="1.742269053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:43.912376237 +0000 UTC m=+48.821618615" watchObservedRunningTime="2026-07-07 14:57:43.913263525 +0000 UTC m=+48.822505901" Jul 07 14:57:44.031616 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:44.031579 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:45.126082 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:45.126048 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:45.291665 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:45.291633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:45.364872 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:45.364840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:46.154698 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:46.154658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:46.155104 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:46.154754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:46.155104 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:46.154820 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:46.155104 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:46.154897 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls podName:f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a nodeName:}" failed. No retries permitted until 2026-07-07 14:57:54.15487738 +0000 UTC m=+59.064119740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sdnbn" (UID: "f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:46.155306 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:46.155286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:46.333408 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:46.333370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:46.355589 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:46.355552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:57:46.355801 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:46.355696 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:46.355801 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:46.355755 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls podName:4671c654-3695-467b-8745-106c8d5e9bc9 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:02.355739561 +0000 UTC m=+67.264981916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls") pod "dns-default-swmqs" (UID: "4671c654-3695-467b-8745-106c8d5e9bc9") : secret "dns-default-metrics-tls" not found Jul 07 14:57:47.051903 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:47.051861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:47.206818 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:47.206786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:47.499006 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:47.498971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:47.598530 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:47.598499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:47.721487 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:47.721455 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:48.710238 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:48.710202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:48.940688 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:48.940655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:49.346897 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.346865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:49.510841 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.510808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:49.580586 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.580560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:57:49.580586 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.580590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:49.580800 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.580702 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:05.580687738 +0000 UTC m=+70.489930099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : configmap references non-existent config key: service-ca.crt Jul 07 14:57:49.580800 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.580703 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:49.580800 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.580716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:57:49.580800 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.580764 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls podName:25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:05.580747825 +0000 UTC m=+70.489990182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-tkqv8" (UID: "25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:57:49.580969 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.580800 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 14:57:49.580969 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.580858 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs podName:56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:05.580842456 +0000 UTC m=+70.490084827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs") pod "router-default-94cf677fc-f7dtf" (UID: "56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9") : secret "router-metrics-certs-default" not found Jul 07 14:57:49.681514 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.681483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:49.683830 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.683804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8549e815-c4b1-4ca0-b49f-749216db6b38-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-kj5pg\" (UID: \"8549e815-c4b1-4ca0-b49f-749216db6b38\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:49.689336 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.689314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:49.748012 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.747975 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" Jul 07 14:57:49.782508 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.782484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:57:49.782663 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.782646 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:49.782737 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.782668 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f8674859b-hkqh6: secret "image-registry-tls" not found Jul 07 14:57:49.782790 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:57:49.782771 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls podName:3e2407d7-49e7-44a5-bdfb-89692a12b7a8 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:05.782715753 +0000 UTC m=+70.691958127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls") pod "image-registry-6f8674859b-hkqh6" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8") : secret "image-registry-tls" not found Jul 07 14:57:49.890017 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:49.889986 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg"] Jul 07 14:57:50.425689 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.425660 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:50.516891 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.516851 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:50.626814 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.626740 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:50.725191 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.725108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:50.908121 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.908080 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:50.914671 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:50.914632 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" event={"ID":"8549e815-c4b1-4ca0-b49f-749216db6b38","Type":"ContainerStarted","Data":"8444348fa778427f1db533d16144fb0eb7f87f613adab47408d8afcb28307390"} Jul 07 14:57:51.126598 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.126513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:51.190204 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.190165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:51.515560 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.515533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:51.918573 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.918537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" event={"ID":"8549e815-c4b1-4ca0-b49f-749216db6b38","Type":"ContainerStarted","Data":"98640d12b272024f90b501f59b1dea6c4623b38d44003559104f1ab14ed76811"} Jul 07 14:57:51.919124 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.918590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" event={"ID":"8549e815-c4b1-4ca0-b49f-749216db6b38","Type":"ContainerStarted","Data":"c1dad09599f9a4a8fe199d4bc13881fdc6133417a1bd5a0cfc577a806eef1a18"} Jul 07 14:57:51.933585 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:51.933533 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-kj5pg" podStartSLOduration=17.488152467 podStartE2EDuration="18.933517104s" totalImagesPullingTime="1.445364637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:51.932951394 +0000 UTC m=+56.842193772" watchObservedRunningTime="2026-07-07 14:57:51.933517104 +0000 UTC m=+56.842759493" Jul 07 14:57:52.313118 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:52.313086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:52.512252 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:52.512219 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:52.915056 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:52.915018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:53.113343 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:53.113311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:53.310865 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:53.310834 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:53.505180 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:53.505149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:54.220524 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.220488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:54.222802 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.222784 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdnbn\" (UID: \"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a\") " pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:54.288932 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.288900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdnbn" Jul 07 14:57:54.344718 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.344684 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:54.423534 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.423496 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdnbn"] Jul 07 14:57:54.427080 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:57:54.427056 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e109f8_3b65_4ebd_bfd9_ef88ab50c21a.slice/crio-cfe16bc7636799b784fc82efe27c26ef7b35c8d708cdeadb85cd95490af2e186 WatchSource:0}: Error finding container cfe16bc7636799b784fc82efe27c26ef7b35c8d708cdeadb85cd95490af2e186: Status 404 returned error can't find the container with id cfe16bc7636799b784fc82efe27c26ef7b35c8d708cdeadb85cd95490af2e186 Jul 07 14:57:54.546416 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.546328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:54.725097 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.725063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:54.929271 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:54.929223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdnbn" event={"ID":"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a","Type":"ContainerStarted","Data":"cfe16bc7636799b784fc82efe27c26ef7b35c8d708cdeadb85cd95490af2e186"} Jul 07 14:57:55.135144 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:55.135050 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:55.942634 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:55.942598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.332328 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.332214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.510199 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.510170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.727915 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.727880 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.828099 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.828068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.868167 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.868132 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfsf9" Jul 07 14:57:56.910567 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.910535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:56.999207 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:56.999117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:57.567111 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:57.567061 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:57.670375 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:57.670302 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:57.772312 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:57.772275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:58.942472 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:58.942423 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdnbn" event={"ID":"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a","Type":"ContainerStarted","Data":"578edae570338fec01ad70aa27f37004be625c539643118f86fbcbf44c5657c4"} Jul 07 14:57:58.942836 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:58.942492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdnbn" event={"ID":"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a","Type":"ContainerStarted","Data":"be38dfd5161a2f6f4278e80dd20efbf5b944bbf7e68f2af26e8f09b862a57025"} Jul 07 14:57:58.991913 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:58.991878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:59.083129 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:59.083057 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:59.184562 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:59.184518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:59.284539 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:59.284506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:59.659494 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:59.659422 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:57:59.736122 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:57:59.736087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.051095 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.051064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.141270 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.141239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.339418 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.339331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.441248 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.441212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.674051 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.673962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:00.882765 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:00.882733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:01.002057 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.002018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:01.279973 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.279885 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:58:01.282800 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.282622 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:58:01.293058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.293036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68361114-6254-43a5-a56c-3d5a5335dd8c-original-pull-secret\") pod \"global-pull-secret-syncer-vjmx9\" (UID: \"68361114-6254-43a5-a56c-3d5a5335dd8c\") " pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:58:01.381239 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.381202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:58:01.384012 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.383996 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:58:01.394095 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.394077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae1f681f-2387-45ec-8897-a2d785895797-metrics-certs\") pod \"network-metrics-daemon-br4bh\" (UID: \"ae1f681f-2387-45ec-8897-a2d785895797\") " pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:58:01.481812 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.481777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:58:01.481987 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.481870 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjmx9" Jul 07 14:58:01.484334 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.484304 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:58:01.491539 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.491509 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xq58\"" Jul 07 14:58:01.495098 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.495079 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:58:01.499950 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.499933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-br4bh" Jul 07 14:58:01.504942 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.504918 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcvq\" (UniqueName: \"kubernetes.io/projected/0575b88b-6224-4385-a4fa-a8ea278c3ddd-kube-api-access-fkcvq\") pod \"network-check-target-ljwlj\" (UID: \"0575b88b-6224-4385-a4fa-a8ea278c3ddd\") " pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:58:01.637988 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.637953 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-br4bh"] Jul 07 14:58:01.641012 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:01.640984 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1f681f_2387_45ec_8897_a2d785895797.slice/crio-9229276b834823d3f245fce2e71ed41ce6831d6f8f133544fa0dea778da5802e WatchSource:0}: Error finding container 9229276b834823d3f245fce2e71ed41ce6831d6f8f133544fa0dea778da5802e: Status 404 returned error can't find the container with id 9229276b834823d3f245fce2e71ed41ce6831d6f8f133544fa0dea778da5802e Jul 07 14:58:01.641137 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.641098 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vjmx9"] Jul 07 14:58:01.644208 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:01.644182 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68361114_6254_43a5_a56c_3d5a5335dd8c.slice/crio-8d39b610e1397bd54137e3946587e5b9d1a90b2e445add5d2e18d39baf1092f4 WatchSource:0}: Error finding container 8d39b610e1397bd54137e3946587e5b9d1a90b2e445add5d2e18d39baf1092f4: Status 404 returned error can't find the container with id 8d39b610e1397bd54137e3946587e5b9d1a90b2e445add5d2e18d39baf1092f4 Jul 07 14:58:01.798137 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.798041 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9sm\"" Jul 07 14:58:01.806068 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.806043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:58:01.940532 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.940501 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ljwlj"] Jul 07 14:58:01.943935 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:01.943907 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0575b88b_6224_4385_a4fa_a8ea278c3ddd.slice/crio-9ebba6ab5e1825be64e9e21c4b07466543fd30a6cd6da90a665905e325ace6b6 WatchSource:0}: Error finding container 9ebba6ab5e1825be64e9e21c4b07466543fd30a6cd6da90a665905e325ace6b6: Status 404 returned error can't find the container with id 9ebba6ab5e1825be64e9e21c4b07466543fd30a6cd6da90a665905e325ace6b6 Jul 07 14:58:01.958483 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.958450 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-br4bh" event={"ID":"ae1f681f-2387-45ec-8897-a2d785895797","Type":"ContainerStarted","Data":"9229276b834823d3f245fce2e71ed41ce6831d6f8f133544fa0dea778da5802e"} Jul 07 14:58:01.959599 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.959577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vjmx9" event={"ID":"68361114-6254-43a5-a56c-3d5a5335dd8c","Type":"ContainerStarted","Data":"8d39b610e1397bd54137e3946587e5b9d1a90b2e445add5d2e18d39baf1092f4"} Jul 07 14:58:01.960690 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.960667 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljwlj" event={"ID":"0575b88b-6224-4385-a4fa-a8ea278c3ddd","Type":"ContainerStarted","Data":"9ebba6ab5e1825be64e9e21c4b07466543fd30a6cd6da90a665905e325ace6b6"} Jul 07 14:58:01.962592 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.962573 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdnbn" event={"ID":"f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a","Type":"ContainerStarted","Data":"815e14211a84890f8cb00cc41bba678527716d0ac146a98babdd7487b6014fb6"} Jul 07 14:58:01.988397 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:01.988331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sdnbn" podStartSLOduration=17.23805962 podStartE2EDuration="23.988310158s" totalImagesPullingTime="6.750250538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:57:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:01.987538677 +0000 UTC m=+66.896781054" watchObservedRunningTime="2026-07-07 14:58:01.988310158 +0000 UTC m=+66.897552536" Jul 07 14:58:02.107017 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.106933 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:02.390121 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.389420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:58:02.393018 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.392985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4671c654-3695-467b-8745-106c8d5e9bc9-metrics-tls\") pod \"dns-default-swmqs\" (UID: \"4671c654-3695-467b-8745-106c8d5e9bc9\") " pod="openshift-dns/dns-default-swmqs" Jul 07 14:58:02.597777 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.597734 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jkfb7\"" Jul 07 14:58:02.606408 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.606378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-swmqs" Jul 07 14:58:02.836344 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.836310 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-swmqs"] Jul 07 14:58:02.840253 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:02.840222 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4671c654_3695_467b_8745_106c8d5e9bc9.slice/crio-9a1b5ce304fb3abde25572efda62a1c5dfa66e8a3e64a3eac443cf759b4ddb34 WatchSource:0}: Error finding container 9a1b5ce304fb3abde25572efda62a1c5dfa66e8a3e64a3eac443cf759b4ddb34: Status 404 returned error can't find the container with id 9a1b5ce304fb3abde25572efda62a1c5dfa66e8a3e64a3eac443cf759b4ddb34 Jul 07 14:58:02.969212 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.969174 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-br4bh" event={"ID":"ae1f681f-2387-45ec-8897-a2d785895797","Type":"ContainerStarted","Data":"cad61e25f554188307a053e789e0902da800b6d0c103150d33c06091faed5c5a"} Jul 07 14:58:02.971419 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:02.971388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swmqs" event={"ID":"4671c654-3695-467b-8745-106c8d5e9bc9","Type":"ContainerStarted","Data":"9a1b5ce304fb3abde25572efda62a1c5dfa66e8a3e64a3eac443cf759b4ddb34"} Jul 07 14:58:03.978491 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:03.978236 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-br4bh" event={"ID":"ae1f681f-2387-45ec-8897-a2d785895797","Type":"ContainerStarted","Data":"a0b5ebd45f67dba5a082ca467509cea05d476262cdd2b1fbd366ef144121efc1"} Jul 07 14:58:05.622101 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.622058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:58:05.622101 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.622100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:05.622635 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.622133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:05.622908 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.622863 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-service-ca-bundle\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:05.624546 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.624521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9-metrics-certs\") pod \"router-default-94cf677fc-f7dtf\" (UID: \"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9\") " pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:05.625079 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.625052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-tkqv8\" (UID: \"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:58:05.824262 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.824223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:05.826878 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.826849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"image-registry-6f8674859b-hkqh6\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:05.836087 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.836058 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v45g9\"" Jul 07 14:58:05.842995 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.842970 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8ft4t\"" Jul 07 14:58:05.843972 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.843953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" Jul 07 14:58:05.851478 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:05.851450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:06.043746 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.043707 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dqrsp\"" Jul 07 14:58:06.049417 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.049391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:06.915945 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.915883 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-br4bh" podStartSLOduration=70.813877845 podStartE2EDuration="1m11.915861s" totalImagesPullingTime="1.101983155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:03.997816167 +0000 UTC m=+68.907058545" watchObservedRunningTime="2026-07-07 14:58:06.915861 +0000 UTC m=+71.825103378" Jul 07 14:58:06.916357 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.916141 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr"] Jul 07 14:58:06.918728 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.918701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:06.921121 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.921092 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf"] Jul 07 14:58:06.922402 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.922373 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:58:06.922530 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.922451 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:58:06.923050 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.923031 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 14:58:06.923132 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.923038 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:58:06.923509 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.923495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:06.939845 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.939826 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 14:58:06.940121 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.940105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 14:58:06.942469 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.942376 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 14:58:06.943298 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.943275 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr"] Jul 07 14:58:06.945201 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.945020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 14:58:06.945384 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.945368 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:58:06.958937 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:06.958912 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf"] Jul 07 14:58:07.033251 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w58t\" (UniqueName: \"kubernetes.io/projected/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-kube-api-access-6w58t\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.033251 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88159cd2-37df-4696-8796-a6ff5d493e60-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.033648 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033413 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-klusterlet-config\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.033648 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.033648 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-tmp\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.033807 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033656 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq84l\" (UniqueName: \"kubernetes.io/projected/88159cd2-37df-4696-8796-a6ff5d493e60-kube-api-access-sq84l\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.033807 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.033807 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.033974 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.033819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.063512 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.063477 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77fbf46899-424xw"] Jul 07 14:58:07.066254 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.066230 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.072725 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.072698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:07.086799 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.086772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77fbf46899-424xw"] Jul 07 14:58:07.134867 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.134805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.135715 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.135597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnwh9\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-kube-api-access-hnwh9\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.135952 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.135889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-certificates\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.136615 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.136117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w58t\" (UniqueName: \"kubernetes.io/projected/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-kube-api-access-6w58t\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.136773 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.136153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-image-registry-private-configuration\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.136938 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.136894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-trusted-ca\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.137179 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.137107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-installation-pull-secrets\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.137484 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.137404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-tls\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.138560 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88159cd2-37df-4696-8796-a6ff5d493e60-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.138649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138582 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.138649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88159cd2-37df-4696-8796-a6ff5d493e60-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.138759 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-klusterlet-config\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.138759 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-tmp\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq84l\" (UniqueName: \"kubernetes.io/projected/88159cd2-37df-4696-8796-a6ff5d493e60-kube-api-access-sq84l\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/195ce42b-8606-48b4-bdfb-0800d29c113d-ca-trust-extracted\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-bound-sa-token\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.139596 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.138898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.140327 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.140258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-tmp\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.142304 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.142260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.144875 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.144118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-ca\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.144875 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.144731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88159cd2-37df-4696-8796-a6ff5d493e60-hub\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.148933 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.147489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-klusterlet-config\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.153092 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.153042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w58t\" (UniqueName: \"kubernetes.io/projected/bbc52124-7beb-45b4-b80d-067b8e5f5aa8-kube-api-access-6w58t\") pod \"klusterlet-addon-workmgr-696b7f55cc-j6tmr\" (UID: \"bbc52124-7beb-45b4-b80d-067b8e5f5aa8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.155539 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.155491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq84l\" (UniqueName: \"kubernetes.io/projected/88159cd2-37df-4696-8796-a6ff5d493e60-kube-api-access-sq84l\") pod \"cluster-proxy-proxy-agent-69f74bf458-phjrf\" (UID: \"88159cd2-37df-4696-8796-a6ff5d493e60\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.192014 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.191911 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:07.236554 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.232092 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.240892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnwh9\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-kube-api-access-hnwh9\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.240947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-certificates\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.240981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-image-registry-private-configuration\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.241008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-trusted-ca\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.241038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-installation-pull-secrets\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.241066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-tls\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.241134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/195ce42b-8606-48b4-bdfb-0800d29c113d-ca-trust-extracted\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.241163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-bound-sa-token\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.242600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-trusted-ca\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.243917 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.243422 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-certificates\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.244898 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.244813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/195ce42b-8606-48b4-bdfb-0800d29c113d-ca-trust-extracted\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.249020 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.248676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-registry-tls\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.249020 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.248823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" Jul 07 14:58:07.250249 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.249707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-image-registry-private-configuration\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.251065 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.251000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/195ce42b-8606-48b4-bdfb-0800d29c113d-installation-pull-secrets\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.255654 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.255606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-bound-sa-token\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.260610 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.260462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnwh9\" (UniqueName: \"kubernetes.io/projected/195ce42b-8606-48b4-bdfb-0800d29c113d-kube-api-access-hnwh9\") pod \"image-registry-77fbf46899-424xw\" (UID: \"195ce42b-8606-48b4-bdfb-0800d29c113d\") " pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.279001 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.278971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:07.339311 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.339112 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94cf677fc-f7dtf"] Jul 07 14:58:07.364955 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.364792 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:58:07.375568 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.375378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:07.385580 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.383064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:07.403071 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.399529 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8"] Jul 07 14:58:07.484636 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.484606 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr"] Jul 07 14:58:07.490196 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:07.489886 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc52124_7beb_45b4_b80d_067b8e5f5aa8.slice/crio-cdf75a377f8718a86946c8d0279ecb792510667a4c59e958aca7fa62d3040779 WatchSource:0}: Error finding container cdf75a377f8718a86946c8d0279ecb792510667a4c59e958aca7fa62d3040779: Status 404 returned error can't find the container with id cdf75a377f8718a86946c8d0279ecb792510667a4c59e958aca7fa62d3040779 Jul 07 14:58:07.516376 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.516217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf"] Jul 07 14:58:07.522640 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:07.520809 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88159cd2_37df_4696_8796_a6ff5d493e60.slice/crio-b1a243f1a1309c6270ee4633949dbb214f7bd9d37a0c7aabf37ec75af57edcf8 WatchSource:0}: Error finding container b1a243f1a1309c6270ee4633949dbb214f7bd9d37a0c7aabf37ec75af57edcf8: Status 404 returned error can't find the container with id b1a243f1a1309c6270ee4633949dbb214f7bd9d37a0c7aabf37ec75af57edcf8 Jul 07 14:58:07.583695 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:07.583663 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77fbf46899-424xw"] Jul 07 14:58:07.587494 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:07.587471 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195ce42b_8606_48b4_bdfb_0800d29c113d.slice/crio-e98e2129ff71d24637a1289a73550db285691de669151976651a48f25c4c2007 WatchSource:0}: Error finding container e98e2129ff71d24637a1289a73550db285691de669151976651a48f25c4c2007: Status 404 returned error can't find the container with id e98e2129ff71d24637a1289a73550db285691de669151976651a48f25c4c2007 Jul 07 14:58:08.000507 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.000467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vjmx9" event={"ID":"68361114-6254-43a5-a56c-3d5a5335dd8c","Type":"ContainerStarted","Data":"efa6ffd1d95d9e8de05eed5bbbf00c04a4f7b088a94cbe12f31676d69e8ba507"} Jul 07 14:58:08.004092 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.003906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ljwlj" event={"ID":"0575b88b-6224-4385-a4fa-a8ea278c3ddd","Type":"ContainerStarted","Data":"546700e3895a8d0e7f56c021defcd6b4fe7ee3ec3ac65f8288d68a2be8ac2942"} Jul 07 14:58:08.004092 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.003955 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:58:08.006522 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.006497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swmqs" event={"ID":"4671c654-3695-467b-8745-106c8d5e9bc9","Type":"ContainerStarted","Data":"aea02a54c87c2b1f9881ea2de59b6ab944140a2d5d32e77e2019bef0fd1ba808"} Jul 07 14:58:08.006628 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.006545 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swmqs" event={"ID":"4671c654-3695-467b-8745-106c8d5e9bc9","Type":"ContainerStarted","Data":"69e7dd34a3cc4c8ba0f8c5804e8266ad941dc50d7bf34c79b4872dac798c6793"} Jul 07 14:58:08.007058 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.007039 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-swmqs" Jul 07 14:58:08.008371 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.008321 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" event={"ID":"88159cd2-37df-4696-8796-a6ff5d493e60","Type":"ContainerStarted","Data":"b1a243f1a1309c6270ee4633949dbb214f7bd9d37a0c7aabf37ec75af57edcf8"} Jul 07 14:58:08.010285 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.010263 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94cf677fc-f7dtf" event={"ID":"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9","Type":"ContainerStarted","Data":"ee36a6bcd1630a2727fa01aa96069a450f809f843cc1b82aeddb498b1be63c10"} Jul 07 14:58:08.010426 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.010410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94cf677fc-f7dtf" event={"ID":"56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9","Type":"ContainerStarted","Data":"3ec6c01c29c7cf3f0d6b5f163d095e2c55e928d1d2e33709071268f56d6c55d5"} Jul 07 14:58:08.012862 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.012783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" event={"ID":"3e2407d7-49e7-44a5-bdfb-89692a12b7a8","Type":"ContainerStarted","Data":"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87"} Jul 07 14:58:08.012862 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.012824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" event={"ID":"3e2407d7-49e7-44a5-bdfb-89692a12b7a8","Type":"ContainerStarted","Data":"5cc87a09bf8bebbb1fe626b494c9ed442d0247c54c5ebcb665de1edbaa4203a4"} Jul 07 14:58:08.013084 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.013027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:08.015192 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.015169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" event={"ID":"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9","Type":"ContainerStarted","Data":"81349c426e2472452b78831081c15886f054f5daa5e3b619340921baeff37e48"} Jul 07 14:58:08.020254 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.019466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fbf46899-424xw" event={"ID":"195ce42b-8606-48b4-bdfb-0800d29c113d","Type":"ContainerStarted","Data":"f0dd3b8c456c499f85505bd5cb7f4380328b7fd78e2e974b4d7abc05d8d8ea2d"} Jul 07 14:58:08.020254 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.019508 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fbf46899-424xw" event={"ID":"195ce42b-8606-48b4-bdfb-0800d29c113d","Type":"ContainerStarted","Data":"e98e2129ff71d24637a1289a73550db285691de669151976651a48f25c4c2007"} Jul 07 14:58:08.020254 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.020151 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:08.020467 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.020372 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vjmx9" podStartSLOduration=67.54813422 podStartE2EDuration="1m13.020357016s" totalImagesPullingTime="5.472222796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.016459051 +0000 UTC m=+72.925701427" watchObservedRunningTime="2026-07-07 14:58:08.020357016 +0000 UTC m=+72.929599396" Jul 07 14:58:08.021999 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.021948 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" event={"ID":"bbc52124-7beb-45b4-b80d-067b8e5f5aa8","Type":"ContainerStarted","Data":"cdf75a377f8718a86946c8d0279ecb792510667a4c59e958aca7fa62d3040779"} Jul 07 14:58:08.042273 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.041961 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" podStartSLOduration=35.041942759 podStartE2EDuration="35.041942759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.041222073 +0000 UTC m=+72.950464446" watchObservedRunningTime="2026-07-07 14:58:08.041942759 +0000 UTC m=+72.951185136" Jul 07 14:58:08.075123 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.074902 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ljwlj" podStartSLOduration=67.909448203 podStartE2EDuration="1m13.074880098s" totalImagesPullingTime="5.165431895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.0735628 +0000 UTC m=+72.982805180" watchObservedRunningTime="2026-07-07 14:58:08.074880098 +0000 UTC m=+72.984122476" Jul 07 14:58:08.099656 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.099596 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-94cf677fc-f7dtf" podStartSLOduration=35.09957477 podStartE2EDuration="35.09957477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.09939154 +0000 UTC m=+73.008633918" watchObservedRunningTime="2026-07-07 14:58:08.09957477 +0000 UTC m=+73.008817148" Jul 07 14:58:08.122905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.122568 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-swmqs" podStartSLOduration=33.853983646 podStartE2EDuration="38.122547008s" totalImagesPullingTime="4.268563362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.121040815 +0000 UTC m=+73.030283206" watchObservedRunningTime="2026-07-07 14:58:08.122547008 +0000 UTC m=+73.031789385" Jul 07 14:58:08.146436 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.145018 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77fbf46899-424xw" podStartSLOduration=1.145002818 podStartE2EDuration="1.145002818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:08.143934923 +0000 UTC m=+73.053177297" watchObservedRunningTime="2026-07-07 14:58:08.145002818 +0000 UTC m=+73.054245198" Jul 07 14:58:08.852213 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.852180 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:08.855779 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:08.855752 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:09.030284 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:09.030157 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:09.031485 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:09.031380 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-94cf677fc-f7dtf" Jul 07 14:58:10.521339 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:10.521292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:10.609963 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:10.609919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:10.698836 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:10.698799 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:11.804117 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:11.804082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:11.908838 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:11.908804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:12.255040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:12.255002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:12.340638 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:12.340605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:13.047123 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.047094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" event={"ID":"25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9","Type":"ContainerStarted","Data":"cac61a907d1e20a2708a12189e02cae5e0443eda3341c5903bfee1f76464195d"} Jul 07 14:58:13.048783 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.048750 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" event={"ID":"bbc52124-7beb-45b4-b80d-067b8e5f5aa8","Type":"ContainerStarted","Data":"014c18775f2d2ce6a2c259e37e7bd2e9af140a789a8627e076e4a11bb2600017"} Jul 07 14:58:13.048974 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.048954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:13.050887 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.050865 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" Jul 07 14:58:13.052040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.051965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" event={"ID":"88159cd2-37df-4696-8796-a6ff5d493e60","Type":"ContainerStarted","Data":"bb7ce5f28df29bc1e5cd881dd186ca494c6c9372817cbb4890047ad88b8a6eb6"} Jul 07 14:58:13.052040 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.052005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" event={"ID":"88159cd2-37df-4696-8796-a6ff5d493e60","Type":"ContainerStarted","Data":"4b736e035b7e77a318af3c255f0bdce0ddaf98d9c0531883232be5269c71b96e"} Jul 07 14:58:13.078816 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.078726 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-tkqv8" podStartSLOduration=34.637404982 podStartE2EDuration="40.078704911s" totalImagesPullingTime="5.441299929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:13.077185744 +0000 UTC m=+77.986428123" watchObservedRunningTime="2026-07-07 14:58:13.078704911 +0000 UTC m=+77.987947290" Jul 07 14:58:13.105543 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.105133 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-696b7f55cc-j6tmr" podStartSLOduration=1.708630691 podStartE2EDuration="7.105112969s" totalImagesPullingTime="5.396482278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:13.10313386 +0000 UTC m=+78.012376238" watchObservedRunningTime="2026-07-07 14:58:13.105112969 +0000 UTC m=+78.014355347" Jul 07 14:58:13.279304 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.279272 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:13.374699 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.374669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:13.475509 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.475479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:13.845668 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:13.845635 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:14.057523 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:14.057486 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" event={"ID":"88159cd2-37df-4696-8796-a6ff5d493e60","Type":"ContainerStarted","Data":"bdfd4d622112ccacf679bace1f812d6f64a381cc7bf25bf86fe5669012e776c7"} Jul 07 14:58:14.085361 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:14.085306 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69f74bf458-phjrf" podStartSLOduration=2.721374803 podStartE2EDuration="8.085289646s" totalImagesPullingTime="5.363914843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:14.084223132 +0000 UTC m=+78.993465510" watchObservedRunningTime="2026-07-07 14:58:14.085289646 +0000 UTC m=+78.994532022" Jul 07 14:58:14.509711 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:14.509676 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:14.578108 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:14.578071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:15.297704 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:15.297666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:15.381812 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:15.381781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.035581 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.035459 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-swmqs" Jul 07 14:58:19.102198 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.102165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.235834 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.235805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.314215 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.314120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.503087 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.503003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.580833 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.580749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:19.935736 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:19.935704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:20.682992 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:20.682958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:20.785816 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:20.785778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:22.498104 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:22.498070 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:22.575731 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:22.575697 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:23.130128 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:23.130088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:24.668729 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.668695 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:24.910857 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.910823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:24.955020 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.954985 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-556s9"] Jul 07 14:58:24.960071 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.960047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:24.962305 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.962288 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:58:24.962390 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.962291 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:58:24.962979 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.962962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wp8w\"" Jul 07 14:58:24.963018 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.962964 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:58:24.963471 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:24.963457 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:58:25.026297 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.026263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:25.087064 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2x5\" (UniqueName: \"kubernetes.io/projected/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-kube-api-access-7c2x5\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087064 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-wtmp\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-sys\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087204 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-metrics-client-ca\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-textfile\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.087282 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.087276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-root\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.131254 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.131217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:25.188498 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-textfile\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-root\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2x5\" (UniqueName: \"kubernetes.io/projected/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-kube-api-access-7c2x5\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-wtmp\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-sys\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-root\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-sys\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188666 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188701 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188768 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-wtmp\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-metrics-client-ca\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.188782 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-textfile\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:58:25.188862 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:58:25.188954 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:58:25.188943 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls podName:6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:25.68891997 +0000 UTC m=+90.598162339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls") pod "node-exporter-556s9" (UID: "6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1") : secret "node-exporter-tls" not found Jul 07 14:58:25.189303 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.189286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.189392 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.189369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-metrics-client-ca\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.190909 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.190878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.198889 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.198858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2x5\" (UniqueName: \"kubernetes.io/projected/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-kube-api-access-7c2x5\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.227320 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.227220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:25.620901 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.620819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:25.693150 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.693118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:25.693546 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:58:25.693288 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:58:25.693546 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:58:25.693389 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls podName:6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:26.693363784 +0000 UTC m=+91.602606148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls") pod "node-exporter-556s9" (UID: "6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1") : secret "node-exporter-tls" not found Jul 07 14:58:25.770897 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.770863 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:25.911754 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:25.911668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:26.118287 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.118252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:26.337043 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.337008 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:26.422892 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.422860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:26.702823 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.702789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:26.705101 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.705079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1-node-exporter-tls\") pod \"node-exporter-556s9\" (UID: \"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1\") " pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:26.772905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:26.772869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-556s9" Jul 07 14:58:26.785693 ip-10-0-138-241 kubenswrapper[2558]: W0707 14:58:26.785665 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d93b9f3_f5be_48c2_8fe4_c3b7b8e021e1.slice/crio-f3ae6fb74cc1f54f12f5c5de1d12b8da0f0292f0cac257d0932812beabbc969d WatchSource:0}: Error finding container f3ae6fb74cc1f54f12f5c5de1d12b8da0f0292f0cac257d0932812beabbc969d: Status 404 returned error can't find the container with id f3ae6fb74cc1f54f12f5c5de1d12b8da0f0292f0cac257d0932812beabbc969d Jul 07 14:58:27.102817 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:27.102739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-556s9" event={"ID":"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1","Type":"ContainerStarted","Data":"f3ae6fb74cc1f54f12f5c5de1d12b8da0f0292f0cac257d0932812beabbc969d"} Jul 07 14:58:27.332730 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:27.332679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:27.414144 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:27.414068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:27.543176 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:27.543144 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:27.934056 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:27.934020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:28.013297 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.013261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:28.018248 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.018224 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:28.107387 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.107352 2558 generic.go:356] "Generic (PLEG): container finished" podID="6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1" containerID="08af1861dc8de7fcb850e0818a1bcec15dc8622f7770a8c05daab309ad5e7e1c" exitCode=0 Jul 07 14:58:28.107558 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.107469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-556s9" event={"ID":"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1","Type":"ContainerDied","Data":"08af1861dc8de7fcb850e0818a1bcec15dc8622f7770a8c05daab309ad5e7e1c"} Jul 07 14:58:28.350160 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.350134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:28.628246 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:28.628166 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:29.112879 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.112843 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-556s9" event={"ID":"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1","Type":"ContainerStarted","Data":"09216f5c9720cee659a684eb3dfc937b37296ae181239066917390ee070df9e5"} Jul 07 14:58:29.113265 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.112894 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-556s9" event={"ID":"6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1","Type":"ContainerStarted","Data":"243ca02e15aef52dabebbecbd5ebc270dfe36bdeab2722ad82756f676b42b3b5"} Jul 07 14:58:29.133613 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.133567 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-556s9" podStartSLOduration=4.187220929 podStartE2EDuration="5.133552694s" totalImagesPullingTime="881.00115ms" totalInitContainerRuntime="65.330615ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:29.132709921 +0000 UTC m=+94.041952298" watchObservedRunningTime="2026-07-07 14:58:29.133552694 +0000 UTC m=+94.042795117" Jul 07 14:58:29.359126 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.359091 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:29.519366 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.519333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:29.703083 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.703055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:29.802391 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:29.802310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:30.038023 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:30.037996 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77fbf46899-424xw" Jul 07 14:58:30.268842 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:30.268808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:30.375228 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:30.375192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:31.365488 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:31.365432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:31.467105 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:31.467071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:32.377999 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:32.377968 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:32.470980 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:32.470946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:33.037334 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.037298 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" podUID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" containerName="registry" containerID="cri-o://602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87" gracePeriod=30 Jul 07 14:58:33.280613 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.280581 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:33.314671 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.314597 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:33.399264 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.399228 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:33.459462 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459397 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459495 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459515 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459530 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459564 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459605 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459649 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459634 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6np5b\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459934 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459673 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets\") pod \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\" (UID: \"3e2407d7-49e7-44a5-bdfb-89692a12b7a8\") " Jul 07 14:58:33.459991 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.459937 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:33.460042 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.460002 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:33.462178 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.462128 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:33.462314 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.462227 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:33.462381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.462308 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:33.462381 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.462367 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:33.462486 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.462414 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b" (OuterVolumeSpecName: "kube-api-access-6np5b") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "kube-api-access-6np5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:33.467997 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.467968 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3e2407d7-49e7-44a5-bdfb-89692a12b7a8" (UID: "3e2407d7-49e7-44a5-bdfb-89692a12b7a8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:58:33.560676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560638 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-bound-sa-token\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560669 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-image-registry-private-configuration\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560676 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560681 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6np5b\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-kube-api-access-6np5b\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560690 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-installation-pull-secrets\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560699 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-ca-trust-extracted\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560708 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-trusted-ca\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560716 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:33.560905 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:33.560723 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e2407d7-49e7-44a5-bdfb-89692a12b7a8-registry-certificates\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 14:58:34.137621 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.137585 2558 generic.go:356] "Generic (PLEG): container finished" podID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" containerID="602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87" exitCode=0 Jul 07 14:58:34.137791 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.137630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" event={"ID":"3e2407d7-49e7-44a5-bdfb-89692a12b7a8","Type":"ContainerDied","Data":"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87"} Jul 07 14:58:34.137791 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.137635 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" Jul 07 14:58:34.137791 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.137668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8674859b-hkqh6" event={"ID":"3e2407d7-49e7-44a5-bdfb-89692a12b7a8","Type":"ContainerDied","Data":"5cc87a09bf8bebbb1fe626b494c9ed442d0247c54c5ebcb665de1edbaa4203a4"} Jul 07 14:58:34.137791 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.137686 2558 scope.go:117] "RemoveContainer" containerID="602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87" Jul 07 14:58:34.145410 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.145389 2558 scope.go:117] "RemoveContainer" containerID="602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87" Jul 07 14:58:34.145726 ip-10-0-138-241 kubenswrapper[2558]: E0707 14:58:34.145707 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87\": container with ID starting with 602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87 not found: ID does not exist" containerID="602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87" Jul 07 14:58:34.145804 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.145740 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87"} err="failed to get container status \"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87\": rpc error: code = NotFound desc = could not find container \"602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87\": container with ID starting with 602cbd7407b55d00ec37e45855c013d52e0cc8fd54d2d7a740e107570f43ce87 not found: ID does not exist" Jul 07 14:58:34.155261 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.155238 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:58:34.160205 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.160184 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f8674859b-hkqh6"] Jul 07 14:58:34.822078 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.822038 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:34.993501 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:34.993470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:35.573701 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:35.573664 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" path="/var/lib/kubelet/pods/3e2407d7-49e7-44a5-bdfb-89692a12b7a8/volumes" Jul 07 14:58:39.032473 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:39.032426 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ljwlj" Jul 07 14:58:39.207736 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:39.207704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:39.311345 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:39.311265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:41.820167 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:41.820139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:41.918602 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:41.918570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:43.586609 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:43.586573 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:43.659380 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:43.659350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:43.814128 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:43.814087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:43.914803 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:43.914694 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:44.016128 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:44.016093 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:44.703320 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:44.703289 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94cf677fc-f7dtf_56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9/router/0.log" Jul 07 14:58:44.722928 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:44.722901 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnfdt_7d1ae07e-71f5-43ab-b55c-f46e745ddee6/serve-healthcheck-canary/0.log" Jul 07 14:58:48.782801 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:48.782757 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:48.886457 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:48.886408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:48.948882 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:48.948848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:56.805672 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:56.805633 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:56.876121 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:58:56.876076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:11.803859 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:11.803783 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:11.865751 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:11.865720 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:44.222339 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:44.222305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:44.704857 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:44.704822 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:53.387493 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:53.387376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:57.555186 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:57.555132 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:59.508635 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:59.508588 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:59.691156 ip-10-0-138-241 kubenswrapper[2558]: I0707 14:59:59.691121 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:11.436091 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:11.436042 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:11.536687 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:11.536655 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:14.697156 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:14.697118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:14.800434 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:14.800378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:15.141025 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:15.140913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:15.241837 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:15.241797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:15.299971 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:15.299939 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:24.664251 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:24.664214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:24.765156 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:24.765128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:26.820027 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:26.819979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:27.153151 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:27.153062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:00:27.218833 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:00:27.218787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:38.362718 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:38.362645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:38.537325 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:38.537255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:40.056014 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:40.055982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:55.450358 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:55.450331 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:01:57.188140 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:57.188104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:58.523604 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:01:58.523576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:25.700477 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:25.700423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:25.807573 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:25.807533 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.529412 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:31.529377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.819651 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:31.819552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.917479 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:31.917417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:32.008404 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:32.008370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:32.098353 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:32.098256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:32.206242 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:32.206211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:32.317891 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:32.317854 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:32.416890 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:32.416794 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:33.395763 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:33.395714 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:33.510009 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:02:33.509976 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:35.768684 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:35.768638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:35.861141 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:35.861109 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:38.227434 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:38.227402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:38.305561 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:38.305527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:42.690153 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:42.690107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:42.774901 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:42.774869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:42.877829 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:42.877796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:43.022731 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:43.022637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:43.167656 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:43.167612 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:43.293746 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:43.293647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:43.377039 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:43.377006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:43.447595 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:03:43.447568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:47.378999 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:04:47.378963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:05.328251 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:05.328223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:05.476623 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:05.476583 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:05.591878 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:05.591775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:05.685140 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:05.685100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:06.787766 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:06.787733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:06.862636 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:06.862600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:17.447090 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:05:17.447044 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:29.203736 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:29.203701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:29.300896 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:29.300864 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:40.607430 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:40.607390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:40.706117 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:40.706075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:44.995192 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:44.995153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:51.894179 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:51.894127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:52.097134 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:06:52.097103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:44.971875 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:07:44.971837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:10.717056 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:10.717015 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:10.797829 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:10.797792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:37.069013 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:37.068982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:37.196245 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:37.196210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:37.291738 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:37.291698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:37.391162 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:37.391083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:37.516538 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:08:37.516506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:27.144034 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.143953 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:10:27.144621 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.144314 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" containerName="registry" Jul 07 15:10:27.144621 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.144331 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" containerName="registry" Jul 07 15:10:27.144621 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.144409 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e2407d7-49e7-44a5-bdfb-89692a12b7a8" containerName="registry" Jul 07 15:10:27.147121 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.147099 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.149519 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.149499 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-e3a4a-serving-cert\"" Jul 07 15:10:27.149621 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.149601 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z5ftp\"" Jul 07 15:10:27.149737 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.149721 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 15:10:27.150049 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.150029 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-e3a4a-kube-rbac-proxy-sar-config\"" Jul 07 15:10:27.156064 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.156036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:10:27.185614 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.185571 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:27.223707 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.223677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.223913 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.223716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.284418 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.284381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:27.324377 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.324343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.324537 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.324392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.325270 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.325241 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.326808 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.326790 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls\") pod \"model-chainer-raw-e3a4a-9c8cdb665-bslgn\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.457564 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.457525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:27.588786 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.588751 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:10:27.592587 ip-10-0-138-241 kubenswrapper[2558]: W0707 15:10:27.592557 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1733cdfe_0472_4d0a_a6af_9838c69d758e.slice/crio-b2a6ea944e5d69cc5ed5da977d43ebbb1a6098f86e022c0618ed86b31be21f44 WatchSource:0}: Error finding container b2a6ea944e5d69cc5ed5da977d43ebbb1a6098f86e022c0618ed86b31be21f44: Status 404 returned error can't find the container with id b2a6ea944e5d69cc5ed5da977d43ebbb1a6098f86e022c0618ed86b31be21f44 Jul 07 15:10:27.594346 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:27.594326 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:10:28.531979 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:28.531940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" event={"ID":"1733cdfe-0472-4d0a-a6af-9838c69d758e","Type":"ContainerStarted","Data":"b2a6ea944e5d69cc5ed5da977d43ebbb1a6098f86e022c0618ed86b31be21f44"} Jul 07 15:10:30.542057 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:30.541399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" event={"ID":"1733cdfe-0472-4d0a-a6af-9838c69d758e","Type":"ContainerStarted","Data":"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0"} Jul 07 15:10:30.542057 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:30.541948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:10:30.558225 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:30.558179 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podStartSLOduration=1.264597383 podStartE2EDuration="3.558163159s" totalImagesPullingTime="2.293565776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:10:30.557323126 +0000 UTC m=+815.466565506" watchObservedRunningTime="2026-07-07 15:10:30.558163159 +0000 UTC m=+815.467405537" Jul 07 15:10:37.211178 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.211143 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:10:37.211653 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.211341 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" containerID="cri-o://a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0" gracePeriod=30 Jul 07 15:10:37.216836 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.216799 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:10:37.230707 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.230671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.377890 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.377857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.481978 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.481888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.582303 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.582271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.654099 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.654063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.757181 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.757094 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:37.900329 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:37.900296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:42.217080 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:42.217029 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:10:47.216492 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:47.216431 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:10:52.216314 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:52.216252 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:10:57.215227 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:10:57.215190 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:11:02.215362 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:02.215322 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:11:07.215419 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.215379 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:11:07.361379 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.361350 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:11:07.401510 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.401473 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls\") pod \"1733cdfe-0472-4d0a-a6af-9838c69d758e\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " Jul 07 15:11:07.401700 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.401537 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle\") pod \"1733cdfe-0472-4d0a-a6af-9838c69d758e\" (UID: \"1733cdfe-0472-4d0a-a6af-9838c69d758e\") " Jul 07 15:11:07.401931 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.401896 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "1733cdfe-0472-4d0a-a6af-9838c69d758e" (UID: "1733cdfe-0472-4d0a-a6af-9838c69d758e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:11:07.403709 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.403684 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1733cdfe-0472-4d0a-a6af-9838c69d758e" (UID: "1733cdfe-0472-4d0a-a6af-9838c69d758e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:11:07.502810 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.502725 2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1733cdfe-0472-4d0a-a6af-9838c69d758e-proxy-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 15:11:07.502810 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.502754 2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1733cdfe-0472-4d0a-a6af-9838c69d758e-openshift-service-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 15:11:07.663358 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.663315 2558 generic.go:356] "Generic (PLEG): container finished" podID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerID="a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0" exitCode=0 Jul 07 15:11:07.663567 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.663365 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" Jul 07 15:11:07.663567 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.663406 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" event={"ID":"1733cdfe-0472-4d0a-a6af-9838c69d758e","Type":"ContainerDied","Data":"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0"} Jul 07 15:11:07.663567 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.663478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn" event={"ID":"1733cdfe-0472-4d0a-a6af-9838c69d758e","Type":"ContainerDied","Data":"b2a6ea944e5d69cc5ed5da977d43ebbb1a6098f86e022c0618ed86b31be21f44"} Jul 07 15:11:07.664872 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.663504 2558 scope.go:117] "RemoveContainer" containerID="a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0" Jul 07 15:11:07.672601 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.672583 2558 scope.go:117] "RemoveContainer" containerID="a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0" Jul 07 15:11:07.672824 ip-10-0-138-241 kubenswrapper[2558]: E0707 15:11:07.672804 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0\": container with ID starting with a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0 not found: ID does not exist" containerID="a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0" Jul 07 15:11:07.672869 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.672832 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0"} err="failed to get container status \"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0\": rpc error: code = NotFound desc = could not find container \"a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0\": container with ID starting with a7841f3d50422d80c9f1c76b6e5a6039008db75916f277e4111aa443bd2fbab0 not found: ID does not exist" Jul 07 15:11:07.678148 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.678125 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:11:07.681536 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:07.681516 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3a4a-9c8cdb665-bslgn"] Jul 07 15:11:09.574250 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:09.574207 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" path="/var/lib/kubelet/pods/1733cdfe-0472-4d0a-a6af-9838c69d758e/volumes" Jul 07 15:11:29.040708 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:11:29.040669 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:17.436852 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.436815 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:17.439136 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.437079 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" Jul 07 15:12:17.439136 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.437093 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" Jul 07 15:12:17.439136 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.437159 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1733cdfe-0472-4d0a-a6af-9838c69d758e" containerName="model-chainer-raw-e3a4a" Jul 07 15:12:17.439994 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.439975 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.442156 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.442120 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c0f7d-serving-cert\"" Jul 07 15:12:17.442279 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.442173 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 15:12:17.442279 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.442142 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c0f7d-kube-rbac-proxy-sar-config\"" Jul 07 15:12:17.442279 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.442232 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z5ftp\"" Jul 07 15:12:17.448996 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.448970 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:17.455286 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.455240 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:17.527649 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.527611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.527826 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.527669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.545551 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.545519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:17.628349 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.628307 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.628553 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.628370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.628977 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.628957 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.630770 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.630752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls\") pod \"model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.751232 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.751135 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:17.880235 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.880200 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:17.883579 ip-10-0-138-241 kubenswrapper[2558]: W0707 15:12:17.883550 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805dd105_b477_4560_b2dd_c86e0f091cde.slice/crio-e60567b13302c23041c98f150fdb48b79fb2868f1b010e21f4f084473066096d WatchSource:0}: Error finding container e60567b13302c23041c98f150fdb48b79fb2868f1b010e21f4f084473066096d: Status 404 returned error can't find the container with id e60567b13302c23041c98f150fdb48b79fb2868f1b010e21f4f084473066096d Jul 07 15:12:17.901869 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:17.901838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" event={"ID":"805dd105-b477-4560-b2dd-c86e0f091cde","Type":"ContainerStarted","Data":"e60567b13302c23041c98f150fdb48b79fb2868f1b010e21f4f084473066096d"} Jul 07 15:12:18.906943 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:18.906899 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" event={"ID":"805dd105-b477-4560-b2dd-c86e0f091cde","Type":"ContainerStarted","Data":"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21"} Jul 07 15:12:18.907325 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:18.906968 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:18.925580 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:18.925525 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podStartSLOduration=1.925511591 podStartE2EDuration="1.925511591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:12:18.925487341 +0000 UTC m=+923.834729715" watchObservedRunningTime="2026-07-07 15:12:18.925511591 +0000 UTC m=+923.834753968" Jul 07 15:12:24.917796 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:24.917760 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:27.471862 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.471831 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:27.472314 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.472104 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" containerID="cri-o://f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21" gracePeriod=30 Jul 07 15:12:27.500013 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.499955 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:27.645674 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.645552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:27.734751 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.734662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:27.807602 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.807572 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:27.909263 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:27.909229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:29.916112 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:29.916068 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:34.915547 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:34.915508 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:37.633725 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:37.633686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:38.062988 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:38.062946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:39.915468 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:39.915370 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:39.915894 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:39.915496 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:44.915786 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:44.915744 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:49.915057 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:49.915012 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:54.915344 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:54.915300 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:12:57.614282 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.614253 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:57.739627 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.739527 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls\") pod \"805dd105-b477-4560-b2dd-c86e0f091cde\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " Jul 07 15:12:57.739627 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.739597 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle\") pod \"805dd105-b477-4560-b2dd-c86e0f091cde\" (UID: \"805dd105-b477-4560-b2dd-c86e0f091cde\") " Jul 07 15:12:57.739976 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.739951 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "805dd105-b477-4560-b2dd-c86e0f091cde" (UID: "805dd105-b477-4560-b2dd-c86e0f091cde"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:12:57.741607 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.741587 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "805dd105-b477-4560-b2dd-c86e0f091cde" (UID: "805dd105-b477-4560-b2dd-c86e0f091cde"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:12:57.840166 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.840126 2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/805dd105-b477-4560-b2dd-c86e0f091cde-proxy-tls\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 15:12:57.840166 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:57.840160 2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/805dd105-b477-4560-b2dd-c86e0f091cde-openshift-service-ca-bundle\") on node \"ip-10-0-138-241.ec2.internal\" DevicePath \"\"" Jul 07 15:12:58.043178 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.043091 2558 generic.go:356] "Generic (PLEG): container finished" podID="805dd105-b477-4560-b2dd-c86e0f091cde" containerID="f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21" exitCode=0 Jul 07 15:12:58.043178 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.043139 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" Jul 07 15:12:58.043367 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.043129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" event={"ID":"805dd105-b477-4560-b2dd-c86e0f091cde","Type":"ContainerDied","Data":"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21"} Jul 07 15:12:58.043367 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.043255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7" event={"ID":"805dd105-b477-4560-b2dd-c86e0f091cde","Type":"ContainerDied","Data":"e60567b13302c23041c98f150fdb48b79fb2868f1b010e21f4f084473066096d"} Jul 07 15:12:58.043367 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.043278 2558 scope.go:117] "RemoveContainer" containerID="f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21" Jul 07 15:12:58.052660 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.052638 2558 scope.go:117] "RemoveContainer" containerID="f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21" Jul 07 15:12:58.052950 ip-10-0-138-241 kubenswrapper[2558]: E0707 15:12:58.052929 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21\": container with ID starting with f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21 not found: ID does not exist" containerID="f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21" Jul 07 15:12:58.053005 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.052959 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21"} err="failed to get container status \"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21\": rpc error: code = NotFound desc = could not find container \"f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21\": container with ID starting with f164b3859fbc0188053f283c7b9c230835988dd3c0f96cf957ae86fec3798f21 not found: ID does not exist" Jul 07 15:12:58.063674 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.063641 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:58.067524 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:58.067500 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c0f7d-74cb8888c-bklx7"] Jul 07 15:12:59.574943 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:12:59.574900 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" path="/var/lib/kubelet/pods/805dd105-b477-4560-b2dd-c86e0f091cde/volumes" Jul 07 15:14:12.998067 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:14:12.998007 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:14.354117 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:14:14.354082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:02.519421 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:15:02.519337 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:03.288742 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:17:03.288707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:08.259095 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:17:08.259065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:08.414224 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:17:08.414185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:54.594530 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:17:54.594402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:38.501360 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:18:38.501325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:39.007304 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:18:39.007273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:57.637523 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:18:57.637473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:57.717520 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:18:57.717483 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:01.728196 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:19:01.728155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:01.998011 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:19:01.997922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:11.773122 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:19:11.773087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:16.915719 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:19:16.915676 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:19:19.726545 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:19:19.726508 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:07.755400 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:20:07.755361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:47.337651 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:20:47.337567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:52.244588 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:20:52.244553 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:52.336829 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:20:52.336793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:23.718294 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:23.718207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:28.989955 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:28.989908 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:29.056097 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:29.056061 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:58.519590 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:58.519537 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:58.672866 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:58.672834 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:58.767105 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:22:58.767069 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:01.393415 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:01.393378 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vjmx9_68361114-6254-43a5-a56c-3d5a5335dd8c/global-pull-secret-syncer/0.log" Jul 07 15:23:01.446780 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:01.446743 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" Jul 07 15:23:01.564486 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:01.564434 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-241.ec2.internal_ce1e171c152e4994dbda02fc177e4774/haproxy/0.log" Jul 07 15:23:04.550298 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:04.550259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:04.621233 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:04.621195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d59v_6f466264-6a26-4389-a552-2e14f7f93464/konnectivity-agent/0.log" limit=1024 Jul 07 15:23:06.184030 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:06.183991 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-tkqv8_25d8ce9c-70e8-42c8-bcad-d7b6c0f1aba9/cluster-monitoring-operator/0.log" Jul 07 15:23:06.361678 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:06.361650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-556s9_6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1/node-exporter/0.log" Jul 07 15:23:06.380067 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:06.380037 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-556s9_6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1/kube-rbac-proxy/0.log" Jul 07 15:23:06.399867 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:06.399837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-556s9_6d93b9f3-f5be-48c2-8fe4-c3b7b8e021e1/init-textfile/0.log" Jul 07 15:23:09.728513 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.728476 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l"] Jul 07 15:23:09.728936 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.728821 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" Jul 07 15:23:09.728936 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.728836 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" Jul 07 15:23:09.728936 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.728892 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="805dd105-b477-4560-b2dd-c86e0f091cde" containerName="model-chainer-raw-hpa-c0f7d" Jul 07 15:23:09.731712 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.731693 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.737146 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.737124 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tv5km\"/\"default-dockercfg-lljgq\"" Jul 07 15:23:09.737967 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.737944 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tv5km\"/\"openshift-service-ca.crt\"" Jul 07 15:23:09.738266 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.738247 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tv5km\"/\"kube-root-ca.crt\"" Jul 07 15:23:09.753123 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.753091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l"] Jul 07 15:23:09.822988 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.822950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-podres\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.822988 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.822993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fvfc\" (UniqueName: \"kubernetes.io/projected/c081957d-4657-4a92-9aad-3b23a0b5a936-kube-api-access-7fvfc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.823214 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.823019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-proc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.823214 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.823104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-sys\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.823214 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.823141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-lib-modules\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923676 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923639 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-podres\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923676 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fvfc\" (UniqueName: \"kubernetes.io/projected/c081957d-4657-4a92-9aad-3b23a0b5a936-kube-api-access-7fvfc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-proc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-sys\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-lib-modules\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923817 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-podres\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-proc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923863 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-sys\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.923916 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.923893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c081957d-4657-4a92-9aad-3b23a0b5a936-lib-modules\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:09.933651 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:09.933625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fvfc\" (UniqueName: \"kubernetes.io/projected/c081957d-4657-4a92-9aad-3b23a0b5a936-kube-api-access-7fvfc\") pod \"perf-node-gather-daemonset-txx9l\" (UID: \"c081957d-4657-4a92-9aad-3b23a0b5a936\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:10.041029 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:10.040939 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:10.172308 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:10.172275 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l"] Jul 07 15:23:10.175377 ip-10-0-138-241 kubenswrapper[2558]: W0707 15:23:10.175352 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc081957d_4657_4a92_9aad_3b23a0b5a936.slice/crio-81d283aa2894bcca2b23752cd1ebdc35d68c15e5c7f2c4a5a532cc20047cf1d1 WatchSource:0}: Error finding container 81d283aa2894bcca2b23752cd1ebdc35d68c15e5c7f2c4a5a532cc20047cf1d1: Status 404 returned error can't find the container with id 81d283aa2894bcca2b23752cd1ebdc35d68c15e5c7f2c4a5a532cc20047cf1d1 Jul 07 15:23:11.094391 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.094356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" event={"ID":"c081957d-4657-4a92-9aad-3b23a0b5a936","Type":"ContainerStarted","Data":"64c657b404b1aad76290d2977fdd8d74fe192b90f4081b1c8506d38bb83a4417"} Jul 07 15:23:11.094795 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.094409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" event={"ID":"c081957d-4657-4a92-9aad-3b23a0b5a936","Type":"ContainerStarted","Data":"81d283aa2894bcca2b23752cd1ebdc35d68c15e5c7f2c4a5a532cc20047cf1d1"} Jul 07 15:23:11.094795 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.094466 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:11.116964 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.116914 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" podStartSLOduration=2.116894689 podStartE2EDuration="2.116894689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:23:11.115847868 +0000 UTC m=+1576.025090248" watchObservedRunningTime="2026-07-07 15:23:11.116894689 +0000 UTC m=+1576.026137068" Jul 07 15:23:11.172062 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.172036 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-swmqs_4671c654-3695-467b-8745-106c8d5e9bc9/dns/0.log" Jul 07 15:23:11.193278 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.193249 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-swmqs_4671c654-3695-467b-8745-106c8d5e9bc9/kube-rbac-proxy/0.log" Jul 07 15:23:11.268288 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.268243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tws2n_d2fa145d-725e-4243-b25e-0d4df112768e/dns-node-resolver/0.log" Jul 07 15:23:11.754244 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.754211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77fbf46899-424xw_195ce42b-8606-48b4-bdfb-0800d29c113d/registry/0.log" Jul 07 15:23:11.803885 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:11.803855 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ft6mk_1e4ab939-1f6a-46d3-924f-2fa5db2bebaf/node-ca/0.log" Jul 07 15:23:12.648906 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:12.648880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94cf677fc-f7dtf_56cc3233-c1c1-4b3c-bcf7-e0c5f38d95f9/router/0.log" Jul 07 15:23:13.048871 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:13.048837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vnfdt_7d1ae07e-71f5-43ab-b55c-f46e745ddee6/serve-healthcheck-canary/0.log" Jul 07 15:23:13.592540 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:13.592513 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdnbn_f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a/kube-rbac-proxy/0.log" Jul 07 15:23:13.613626 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:13.613597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdnbn_f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a/exporter/0.log" Jul 07 15:23:13.646251 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:13.646221 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdnbn_f1e109f8-3b65-4ebd-bfd9-ef88ab50c21a/extractor/0.log" Jul 07 15:23:17.106992 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:17.106965 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-txx9l" Jul 07 15:23:20.664201 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:20.664171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxzkd_a83cdadb-5928-42c1-a58a-091773738978/migrator/0.log" Jul 07 15:23:20.684801 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:20.684768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxzkd_a83cdadb-5928-42c1-a58a-091773738978/graceful-termination/0.log" Jul 07 15:23:22.153011 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.152982 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/kube-multus-additional-cni-plugins/0.log" Jul 07 15:23:22.179888 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.179861 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/egress-router-binary-copy/0.log" Jul 07 15:23:22.201523 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.201496 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/cni-plugins/0.log" Jul 07 15:23:22.228655 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.228625 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/bond-cni-plugin/0.log" Jul 07 15:23:22.250801 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.250773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/routeoverride-cni/0.log" Jul 07 15:23:22.270023 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.269990 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/whereabouts-cni-bincopy/0.log" Jul 07 15:23:22.289647 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.289617 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wftqr_3f85b2e8-9b22-455a-a205-81c84a8a7b68/whereabouts-cni/0.log" Jul 07 15:23:22.483101 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.483063 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cq4sp_285c5ba3-62c8-4edb-940d-5ae9f9e9150e/kube-multus/0.log" Jul 07 15:23:22.608976 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.608944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-br4bh_ae1f681f-2387-45ec-8897-a2d785895797/network-metrics-daemon/0.log" Jul 07 15:23:22.627699 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:22.627671 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-br4bh_ae1f681f-2387-45ec-8897-a2d785895797/kube-rbac-proxy/0.log" Jul 07 15:23:24.010533 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.010495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/ovn-controller/0.log" Jul 07 15:23:24.029498 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.029467 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/ovn-acl-logging/0.log" Jul 07 15:23:24.056345 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.056309 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/kube-rbac-proxy-node/0.log" Jul 07 15:23:24.080179 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.080147 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 15:23:24.100203 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.100170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/northd/0.log" Jul 07 15:23:24.124250 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.124219 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/nbdb/0.log" Jul 07 15:23:24.147406 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.147373 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/sbdb/0.log" Jul 07 15:23:24.204896 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:24.204858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfsf9_9e2bfc63-8331-46a3-90d4-dba7d5da26ad/ovnkube-controller/0.log" Jul 07 15:23:25.329675 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:25.329641 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ljwlj_0575b88b-6224-4385-a4fa-a8ea278c3ddd/network-check-target-container/0.log" Jul 07 15:23:26.453170 ip-10-0-138-241 kubenswrapper[2558]: I0707 15:23:26.453138 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7q2cf_465fd64d-d6fa-4c50-8aa1-5cccea3cbbd7/iptables-alerter/0.log"